Sir Harold Boulton wrote the words around 1884, so I expect it was first publically performed by a professional singer, in a recital of some sort. At least part of the tune is older than that, though; see the various links above for more information.