The National Library of Australia has the sheet music for I DO LIKE TO BE BESIDE THE SEASIDE, although it is not viewable online. The catalogue entry says, "written and composed by John H. Glover-Kind."
Florrie Forde recorded it in 1909. The Internet Archive has the recording.