Surely (to get back to the original query) the question of intent is easy to solve.

If the comment was made with a twinkle in the eye, it was a joke, and probably a challenging bit of flirting.

If it was made in a hostile tone, the person making it was a fool.