All I can think of is the old hymn We're Marching to Zion in which the last verse starts, Then let our songs abound, And ev'ry tear be dry; and then the chorus ends, ...The beautiful city of God.

This is probably not the song you want, but maybe it will jog someone else's memory.

Mary