I realize it is a minor point, and being called a Yank does not drive me into a rage - but it isn't the nicest thing to say. Especially if you are from the South. You could end up with a black eye if you said it to the wrong person.