I read an album note somewhere in the distant past stating that that refrain was teasing the "NY girls" for their, quote, "provincialism": the polka was all the rage, as the kids say, in London and Paris, etc., but hadn't made it to NY, apparently.

I think that would have been from the National Geographic 'Songs of the Sea' album, which turned me into the landlocked old sea-dog I am today.