Is the term Rufus derogatory? Ive never heard it before in that sense. I just thought it was a name. As for Caucasians, I didnt like using that term in the first place. I think anthropologists today say there is no such thing as race, only that people who live in a certain region tend to look similar to people in that area. P.