If the victim is included in the conversation, then it should be OK.; your victim is just being too touchy.

But - You can't tell a joke that is 'about' a victim, who is within hearing, but not part of the conversation. That is being plain rude.

Bert.