The point is that for virtually everyone in the UK, regardless of colour, it doesn't represent the same thing as it does in the USA, and is no more of a symbol for racism than any other American flag.