I have always preferred the version (e.g. a version I heard from John and Tony) with the chorus:

And away, ye Johnnie,
my dear honey!
Oh, you New York Girls
you love us for our money.

The version with the chorus that ends "can't you dance the polka?" grates on my ears.