Sad lack of punctuation in that version!
So for Ill, read I'll, Im = I'm, etc.
And I've always known it as "The drifters I'm leaving, tae work on the Land" (not yard).
Morrison's Haven was just to the east of Edinburgh on the East Lothian coast.