Careless of me not to check Jeri!. As well as the song entry in DT (Jeri's link), there is a whole thread devoted to the song: Lyr Req: Captain Jinks of the Horse Marines with links to many sources for the words and some discussion of the song.
Mick