There is sheet music dated 1865 here on the Levy site




The Little Brown Church





Title: The Little Brown Church. Song and Chorus.
    Composer, Lyricist, Arranger: Words and Music by Wm. S. Pitts.
    Publication: Boston: Oliver Ditson Company, 1865.
    Form of Composition: strophic with chorus
    Instrumentation: piano and voice (solo and satb chorus)
    First Line: There's a church in the valley by the wildwood, no lovelier place in the dale
    First Line of Chorus: Come to the Church by the wildwood,