If the victim is included in the conversation, then it should be OK.; your victim is just being too touchy.
But - You can't tell a joke that is 'about' a victim, who is within hearing, but not part of the conversation. That is being plain rude.
Bert.