I have this in a 'Francis and Day's Album of Old Time Comic Songs' with a copyright date of 1912 and there are a couple of differences from the words you have, he has an Eton suit rather than a hat and the second line of the second verse goes "Well to do and with a few Just place the accent on the 'do'"

The most important difference is that my version has two more verses. The third verse is:

I don't know if it was my Eton boy's suit but all our boys gave me the slip.
As I threw stones in the sea an old fellow came up to me.
He cried, "Hello sonny, are you a native?" I answered, "Now what's the idea?"
Am I a 'native' d'yer think I'm an oyster?", He said, "I mean were you born here?"
A famous old town is Hastings, As history records will teach.
Why William the Conquerer landed at Hastings, Yes landed on this very beach.
I'll give you a shilling, my boy, for yourself If you can tell me straight away,
When _did_ William land?" I said, "I didn't see him, I've only come down for the day."

Your third verse, therefore becomes the fourth verse and the fifth and last verse in my version is:

There on the beach a teetotal brigade Had gathered a very large crowd.
I thought, I may as well stand And hear the sweet strains of the band.
It wasn't bad but somehow the big drum Seemed to worry the drum of my ear.
When that was over, an old chap got up and He said, "My friends be of good cheer,
We've gathered together this morning, to tell you how wicked you've been.
To keep you from spending your money on drink, we shall pass round with our tambourine.
And now, my dear friends, if you've sinn'd in your lives, Come up and confess it I pray!"
Said I, "Well I'd like to confess all my sins, but I've only come down for the day"

I'll agree that the three verses you have are probably the best of the five but thought that putting the other two out there was worth while.