I learned this song from the Spinners in the 60's, but I asked my Gran (who was born in the late 19th century) if she knew anything about Seth Davey. She said that she vaguely remembered the "dancing nigger-man" (pardon the archaism) with a puppet or something.