I must say that when anyone says "Victorian music", for some reason I always think of "Villikins and His Dinah" (although I only know a "rugby" song to the same tune) and "She was poor, but she was honest" (as above, but I do have a partial "cleaner" version of this). You could try "Cheer,Boys Cheer", the "hit song" of the Army in the Crimea. Do you know which bit of the Victorian era you are considering? after all, you have a 64 year span to play with.

Good luck.

Tom