I agree with Steve. If black offends (I don't think it should, as it's not the intention, but no-one wants to hurt people's feelings) then another colour would do just as well. Woad or red (like Red Leicester Morris) or dark green.
I also think that if people were assaulting the Morris dancers in Birmingham by knocking their hats off etc and causing a disturbance, it's a matter for the Police.