Here's an even earlier reference to the tune.

"The Galveston [Texas] Daily News" (Sept. 19, 1865) (pretty far from Georgia) mentions that one of Pres. Andrew Johnson's freedmen was noted for playing "the lively reel commonly known as 'Hell broke loose in Georgia.'"

The writer suggests that Sherman's march had inspired the title.