First verse and chorus copied from http://www.melodylane.net/sea.html

BY THE BEAUTIFUL SEA
(Words, Harold R. Atteridge. Music, Harry Carroll. 1914)

Joe and Jane were always together.
Said Joe to Jane, "I love summer weather,
So let's go to that beautiful sea.
Follow along! Say you're with me!"
Anything that Joe would suggest to her
Jane would always think it was best for her.
So he'd get his Ford,
Holler, "All aboard!
Gosh, I want to be—

CHO: By the sea, by the sea, by the beautiful sea!
You and me, you and me, oh how happy we'll be!
When each wave comes a-rolling in
We will duck or swim,
And we'll float and fool around the water.
Over and under, and then up for air
Pa is rich. Ma is rich, so now what do we care?
I love to be beside your side, beside the sea, beside the seaside,
By the beautiful sea.

[The Levy Sheet Music Collection reveals that there is a little-known second verse. However, 2 pages are missing from the sheet music, so I can only show you how it starts:]

Joe was quite a Sport on a Sunday.
Though he would eat a Childs on a Monday
And Jane would lose her millionaire air....

[Now, can anyone supply the lyrics for the equivalent song that seems to be well known in Britain but unknown in the US—whose chorus begins, "I do love to be beside the seaside. I do love to be beside the sea"? Similar though it sounds, it is really a quite different song, and probably from the same era.]