Yes, what is the relationship with this man?
By itself, there is no crime here. If the man is a complete stranger, or a casual acquaintance, it is odd and could be disconcerting, but not criminal.
If you are concerned then you can always contact the local police with a sort of "FYI" for them.