I sang this as a child in Jamaica in the 1940s well before Harry Belafonte recorded it; it was at least as old as our grandparents. It's a digging song -- the gang leader calls out the first line -- everyone raises his pick-axe to "Hill an' gully rida" and then brings it down with a thud to "Hill an' gully". It could have been adapted from a sea-shanty.