There's this, from Paul Simpson, "The Rough Guide to Cult Football" (2003):

"The oldest known football song still used today is Norwich City's 'On the Ball, City,' written by Albert T. Smith, a City director, around 1890 as a music hall song."