I've heard this as "Botany Bay," sung by Clancy and Makem. I found this version of the lyric, which I've modified to more closely resemble [my memory of] the Clancy/Makem version, in just a few places. I've found several verions of it on the web, actually, none of them exactly like the one I've heard.

Chorus:

Farewell to your bricks and mortar, farewell to your dirty lime
Farewell to your gangers and gang planks
And to hell with your overtime
For the good ship Ragamuffin is lying at the quay
For to take oul Pat with a shovel on his back
To the shores of Botany Bay

I'm on my way down to the quay, where the ship at anchor lay
To command a gang of navvys, that they told me to engage
I thought I'd drop in for a while before I went away
For to take a trip on an emigrant ship to the shores of Botany Bay

(Chorus)

The boss came up this morning, and he says to me "Hello,
If you don't fix your mortar right I'm afraid you'll have to go"
So since he did insult me, I demanded all my pay
And I told him straight, I was going to emigrate to the shores of Botany Bay

(Chorus)

And when I reach Australia I'll go and dig for gold
There's plenty there for the digging of, or so I have been told
Or else I'll go back to my trade and a hundred bricks I'll lay
Because I live for an eight hour shift on the shores of Botany Bay

(Chorus)

Chris