Actually, Phil, I mistranscribed the last verse which should read:
Four and six for a pound of ‘bacca;
Two and six for a pound of tea;
How can we poor railroad rackers,
Come to the bush and have a spree? (CHO)
So "rackers" are most certainly railroad laborers.