Amazon lists this: A Shaker Hymnal: A Facsimile Edition of the 1908 Hymnal of the Canterbury Shakers.

Millennial Praises only has words, no music. Our library has many copies & one is still on my desk from when I was looking up Babylon is Fallen. I can check it for you.

"Early Shaker spirituals" recordings of some of the remaining Shaker sisters made in the 1960's & 70's. It was reissued in 1996 by Rounder on CD 0078. This is essential and is probably the one Bob was thinking of.

"Shaker Songs: Come to Zion," sung by Norumbega Harmony and Singers of Hancock Shaker Village, directed by Stephen Marini. 35 Shaker songs and anthems of all types dating from early hymnals to the 1908 hymnal. Because the Shakers forbade harmony until the late 19th century, all songs on the recording except for eight from later hymnals are sung in unison. Order direct from Norumbega Harmony. It is also available directly from Hancock Shaker Village.

Mitzi Collins, owner of Sampler Records in Rochester, NY, has done a lot of research on Shaker Music. She has 2 recordings & a song book.
Love is Little: A Sampling of Shaker Spirituals M. Collins, R Hall, J Harp, K Johnson, C Liggett, A Nagel-S9222. Songbook has same title.
Joy of Angels - (Christmas Music) Randy Folger, Colleen Liggett, Kathy Leigh Johnson, Mitzie Collins, The Sampler Chorus - S9528

William Coulter & Barry Phillips (& friends) have done 3 lovely instrumental recordings of Shaker Music for Gourd Music. If you don't get the box set & I'm remembering correctly, Shelley Phillips recommended Music on the Mountain to me as her favorite.