"Perhaps we should be slightly less sensitive. "

Replace the 'disability' with race. Do you still think peole should be less sensitive? What's the difference? It's that 'otherness' that makes some target others by way of their "humour".
Humour that needs a victim is not humour, it's an ignorant cheap shot, and so is being an appologist for it.