The song Randy mentioned is most likely the one to which I was referring. It is a well-established African-American traditional gospel song, quite frequently performed by quartets.