Jim,
I don't think that my Roma friends would see me as racist. They would certainly not wish to be confused with travellers. You mix with your people, I mix with mine.