I notice that in a previous thread about this song the line as sung on some recordings is 'as rich as honey dew' so obviously there was some recognition of negative stereotyping previously.

It's often difficult singing old songs written in a different time that clash with modern sentiments but, I've never heard the response you describe accompaning the singing of this song and I would find that equally depressing I think.