Why not use the words stereotype and prejudice instead of labelling someone or something as 'racist'.

Because these words carry very little social stigma, and are therefore pretty useless for the purpose of bringing about conditinos of social justice. And that is what we all want... right?