Nary a mention of the genre label as a negative on the wiki.
There never was a more hegemonic stereotype generator than Hollywood, U.S. of A.. Cher complains but admits to the snake oil and prostitution in the same verses.
The more everyday American street level pejorative would be 'traveler.' But… big ass but here… an African American, Southern Baptist, asphalt sealcoating 'contractor' is still running the 'Traveler scam.' Like a 'Jew' in other contexts (eg: cheap, stingy,) being Roma is neither here nor there in American English.
“Roma Jazz” is the current politically correct generational shuffling of the genre label deck chairs. I doubt Django ever used manouche in general reference to his jazz. The more common record store bin label in its day was “hot jazz” or “hot club.”
And the “CP” in NAACP stands for “African American” and tomorrow and tomorrow and tomorrow....