I'd move. Any neighbourhood that hostile isn't worth living in. I've lived in what are considered the worst neighbourhoods in Halifax, and never been harassed in any way by my neighbours, despite my being a standout eccentric. I presently live in territory reknowned for hardass fishermen prone to ask questions later. No one bothers us and we have plenty friends and great neighbours, for the most part, including the fishermen, who mostly turned out to be pussycats with large biceps.