In fact I agree that there are no words which can't be used in certain contexts, and you gave an example of how that can be so, when they are put them in the mouth of people, or taken from the mouth of people being satirised.

However "retarded people" I would see as just such a term. I accept that you didn't use it with any such intent, but it an expression that is felt like a blow.