Away with rum, by gum, first appeared in print in 1921 in "Michigan's Favorite College Songs, according to Traditional Ballad Index.
They thank Jim Dixon for finding this reference.

Does this reference have an indication of whether it is based on Temperance Union or Salvation Army use?

(Perhaps explained somewhere above, but I have to go, and can't read the entire thread at this time,)