There's another way to go. You can have exclusive residential neighborhoods that most minority families can't afford to but into. In which case you have a defacto form of segregation
that doesn't seem to bother anybody, except the folks who don't have the price of the buy-in.