The Browns also recorded a song called "The Old Village Choir" (Singer) It appears on their 8-CD set "The Three Bells". Barnes&Noble has a sound sample, from which I transcribed:

"...to sing in the old village choir.
In pigtails and big bows, your eyes all aglow,
I held your hand as we sang.
While the congregation..."

"The Voice in the Old Village Choir" (by Gus Kahn and Harry Woods) was recorded by Eddy Arnold on the albums "In the Chapel" and "Sunday with Eddy Arnold & Jim Reeves". It is also on the album "Double Barrel Country: The Legends of Country Music".

This page says it was recorded in 1926 by the Majestic Dance Orchestra with vocalist Harold Van Emburgh.

The Frank Gullo Sheet Music Collection at Millersville University has the sheet music. They will photocopy it for a fee, if it's not under copyright, but their index dates it to 1932, not 1926, so there may be a problem with copyright.