White folks calls you black, but I say not;
Caze de kittle musn' talk about de pot.

This isn't talking about skin color, it's talking about the reason 'black' was a perjorative term. 'Black as the devil' - look at some old artistic portrayals of the devil - he was BLACK. He wasn't a dark shade of 'flesh', he was black as a cast iron pot or kettle. A person can have a black heart or soul, be in a black mood - in that context, it means evil/bad. When I was a kid (early 1960s), I was taught never to refer to someone as 'black'.

I don't believe the adjective, or the song, referred primarily to skin color, but to evil. 'Black' was a bad thing to call a person, because it indicated the darkness of their skin meant they had a 'black', or evil, soul.

Blackbirds and crows are black in color, so they must be evil. After all, they steal corn! I think the song is quite clever. It infers white men steal too, and so are as 'black' as the blackbird and crow.

~~100% opinion~~