It says in Fowke and Glazer's Songs of work and protest:

'The oft-repeated warning in the chorus to "keep your eye upon the scale" refers to the owner's practice of underweighing the miners' coal cars before the unions succeeded in appointing a union checkweighman.'