The lyrics are posted at the thread: Looking for lyrics.
There're two sheet music editions at the Levy Collection (Click on the titles below, and go on to next pages).
(1) Title: A Little Bit of Heaven (Shure They Call It Ireland). [A-flat minor; D-flat major]
Composer, Lyricist, Arranger: Lyric by J. Keirn Brennan. Music by Ernest R. Ball.
Ernest R. Ball Publication: New York: M. Witmark & Sons, 1914.
Form of Composition: introduction and refrain
Instrumentation: piano and voice
First Line: Have you every heard the story of how Ireland got its name?
First Line of Chorus: Shure, a little bit of Heaven fell from out the sky one day
Performer: Sung By Mr. Chauncey Olcott in The Heart of Paddy Whack
Dedicatee: Dedicated to Rita Olcott
Advertisement: ads on inside front, inside back, and on back covers for M. Witmark & Sons stock
Plate Number: 13479-4
Subject: Pride
Subject: Patriotism
Call No.: Box: 153 Item: 072
(2) Title: A Little Bit of Heaven (Shure They Call It Ireland). [G minor; E-flat major]
Composer, Lyricist, Arranger: Lyric by J. Keirn Brennan. Music by Ernest R. Ball.
Ernest R. Ball Publication: New York: M. Witmark & Sons, 1914.
Call No.: Box: 153 Item: 073
Three recordings at The Virtual Gramophone site: (1) Henry Burr/Columbia Stellar Quartet (1916); (2) George MacFarlane (1915); (3) Charles Harrison (1920).
~Masato