Funny how the original sheet music (posted by Joe Offer above) has "Won't you be my Tony Boy" but everybody remembers it as "...pony boy." I wonder what the significance of "Tony Boy" was?

I did find there was a trotting-horse by that name, around that time, but it's hard to tell how famous he was.