The theme of "The Horse Soldiers" doesn't sound much like "TGILBM" to me.

As I remember the words,

"I left my love, my love I left,
A-sleepin' in her be-ed.
I turned my back on my true love,
Went fightin' Johnny Reb.
Went fightin' Johnny Reb.

I left my love a letter
In the hollow of a tree,
I told her she could find me in
The U.S. cavalree.
In the U.S. cavalree!

Hi, ho, down they go,
There's no such word as ca-an't.
We'll all go down to New Or-leens
For Ulysses Simpson Grant.
For Ulysses Simpson Grant.
We'll all go down to HELL and BACK!!!
For Ulysses Simpson Grant."