A correction/addition to the above information. Bayly died in 1839 rather than 1829. The song was published by Rufus Griswold who published a collection of Bayly's songs and poems in Philadelphia in 1843.

This from The American Song Treasury by Theodore Raph.