From a recording made by banjohangout user hektic - cover of Dee Hicks
Listen to the recording here
A (little) more context here

Lincoln was a Union man, Union man was he
He was president and set the slaves all free

Honor boys, honor, honor, don't you know
War is raging and we all have to go

Rather be a Union man, carry a wooden gun
Than always be a rebel and always have to run