A lot of people say they can't "give up" being smokers
I did, and so do many people I know. The prospect of a lingering death, or the witnessed lingering death of a good friend, can be remarkably persuasive.
However, I don't know of anyone who has successfully given up being black. The nearest I can find is Michael Jackson, and he hasn't done it very well!
All of which is a digression. It looks as this comes down to 'It's OK to be prejudiced if my imaginary friend says so.'

< irony>Me, my beef is with the Jews. Why can't they cure themselves. Why should they be allowed to adopt? They ask for 'tolerance and understanding' - I say 'enough already'. How dare they ask for 'rights'. Rights are what belong to the white, christian majority, not to kikes, queers, coons and freaks!
Now fire me up a cross and get me some rope...< /irony>