The terms used offensively for members of minorities subject to some kind of unfair treatment move around all the time. Not just minorities either - being in the majority has rarely saved women from this kind of thing.

"Black" currently is inoffensive, "Coloured" is not. One time it was the other way round. "Queer" has been very much an insult, now it's used positively.

The thing is racists etc can be relied on to use just about any expression in an insulting way, and sooner or later that tarnishes the word. And set against that there is a tradition of taking a word that has been used as an insult and using it with pride.

Get rid of the bigotry and words just become words. But that's quite an ask.