I just do what other 'picked-on' people have done before me; tell the jokes first.
I do think they are often funny, if tongue-in-cheek.

Ian, might I suggest you take up birdwatching and nudism next?

Of course, in England, eccentricity may still attract a little less ridicule than elsewhere. It certainly used to, once.