"Xenophobia, Ruth, is a fear or hatred of aliens/strangers,"

it is equally xenophobic to say "foreigners are fine - I just don't want them in my street/neighbourhood/country. Let them stay where they come from/belong."

Just as it is homophobic to say "homosexuals are fine - I just don't want to have to see them."

Both are about artificially preserving an illusion of homogeneity and "safety" within a majority population. Both are equally deluded and prejudicial.