There's always been a tradition of people taking up insulting labels and trying to take the sting out of them by using them themselves. Sometimes that works, as with Quakers, but it's a tricky one to get away with, and more often than not it doesn't work.

And often enough people will try to use this tendency as a way of trying to claim that the use of these expressions by others isn't actually intended as insulting and felt as insulting.