IMO, the racist element is the idea that "the locals need a White man" to lead them. In all the versions, the Red Shadow/El Khobar is always White. If you changed it, it wouldn't be The Desert Song.