Leeniea is correct, the original poem by Carryl does not mention a boxing glove.
Written in 1884, his poem has no chorus, which is where the boxing glove appeared.

The song was printed in St. Nicholas magazine for children, with the boxing glove chorus, in the 1890s. The "Scottish Students' Song Book" of 1896 published this version, crediting St. Nicholas magazine but not citing an author.