Just curious: if the man is in the US but not in Georgia, would Georgia law apply to him? And does your answer apply to other various subjects such as permission to record the conversation (person A recording from a one-party state while person B resides in a two-party state)?
For recording laws, a person needs to consider the state with the more restrictive laws - so if a caller from a one-party state wants to record a call to a person in a two-party state, the caller needs to get permission from the person in the two-party state. Otherwise the caller has violated the law.
For a civil action like invasion of privacy, either state could claim
jurisdiction - the state with the person who invaded the privacy of another or the state with the person whose privacy was invaded. It depends on all sorts of facts and factors as to which state would be the smartest in which to file a suit.