The 'Jeff Davis' of the song is indeed Jefferson Davis, the President of the southern (Confederate) states who tried to leave the United States during the American Civil War of 1861-5.

He was not hung. He died of old age in New Orleans in 1881.

Thank God for that, because we've been spared any number of morbid songs about his execution.