The OED says:

"prejudice and antagonism towards people of other races, especially those felt to be a threat to one's cultural or racial integrity or economic well-being"

I stand by what I said.