I think that the "boxing glove" was selected to give a nonsensical pairing with "love," and no erotic thoughts were in the mind of the composer of those deathless verses.
I have the Scottish School songbook, and the song appears in other children's songbooks; I haven't checked for original author of the parody or the date.