The dates (1850s) are pretty much the same for both the plantation work songs and the minstrel songs that seem to have contributed lines to the chantey.
The work songs and chanteys are the typical call and response (chorus) required for joint effort, and for some dance forms (also represented in the early examples presented). All three seem to have contributed; I would 'vote' for the minstrel shows (popular with sailors on the shore) as the main source, but much more needs to be searched out with regard to all three forms.

I also wonder what exposure sailors would have had with plantations. African-Americans working either as slaves or freedmen in port cities would have different songs from those on the plantations.

Not the best or best known chantey by any means, but an interesting one. 'Tis a puzzlement.