I am sure that you realise, being from Oz yourself, that the second one starts the same as an Australian song called The Wild Rover, except that it is:
WILD ROVER (NO NAY NEVER)
I've been a wild rover for many a year And I spent all my money on whiskey and beer, And now I'm returning with gold in great store And I never will play the wild rover no more.
cho: And it's no, nay, never, No nay never no more, Will I play the wild rover No never no more.
I think that there is a similar song in the American tradition, but I'm not sure about this. The Oz version is very probably based on an Irish song/tune, and the DT database says that the Clancy Brothers (Irish) sang the Wild Rover.