The next to last line in the version quoted above by Masato Sakurai from Jackson's Spiritual Folk-Songs of Early America makes more sense with "labors" than it does with "neighbors," but Jackson notes that his transcription is "rather defective." Anyway, labors is how I've always sung/heard it.

Another variant: Robin and Linda Williams' recording gives the line "And the Jews sneaked across..." in place of the more common "The Jews safely crossed..." Can anyone provide a source for R&L's variant?