A still earlier reference to the song:

"Bar Room Concerts at Dartmouth Hall on Tuesday Evening, July 25,” Dartmouth Oestrus I (No. 3) (July, 1855):

“Professor John Newton will preside at the organ and favor the rabble with several sacred songs, such as ‘Oh, I’m a used up man,’ ‘One-eyed Riley,’ and others.”