If you like Yanks, or Brits or whatever, it's not an insult. If you don't like them, it is.

It seems to me the same goes for most terms like that. It's just a pity that some terms get overloaded by historical injustice.