I found the reference it's on page 91:

From Hindman, Knot County Kentucky. It is also found by E.C. Perrow Journal XXVI, 147. The title is also "On Heaven's Bright Shore"

We have gone to glory
We have gone to glory
We have gone to glory
Gone to heaven's bright shore.

Some day we'll go and jine 'em
Some day we'll go and jine 'em
Some day we'll go and jine 'em
On heaven's bright shore.

It does have four lines ending with Heaven's bright shore. This may be an early version or a different song. Not conclusive enough, sorry.

Richie