The version of "Shallo Brown" with reference to slavery seems to be a recent remake, (by Helen Schneyer?).
None of the early ones have any mention or allusion to slavery, although mention is made of a mulatto or black woman in some (crossover with "Sally Brown?).