A piece of music is a set of sounds. How can sounds be racist? Lyrics might be racist, because they are the product of a human mind, but sound is merely the product of moving air.

Is the title racist? Clearly nobody knows. But old tunes often have many titles. If you like 'Colored Aristocracy' and want to play it, give it a new title.