"I'm Working on a Building" came from black gospel sources. The Carters learned their version from gospel singer Pauline Gary from Kingsport who was a friend of Leslie Riddle. The Carters also learned "On a Hill Lone and Gray," and "On My Way To Cannan's Land" from her.

Here's the earliest printed lyrics:

"WORKIN' ON THE BUILDING" recorded in Odum & Johnson, The Negro and His Songs (1925, p. 72).

If I wus a sinner man, I tell you what I'd do,
I'd lay down all my sinful ways an' work on the building too.

I'm workin' on the building fer my Lord,
Fer my Lord, fer my Lord,
I'm workin' on the building fer my Lord,
I'm workin' on the building, too.

If I wus a gamblin' man, I tell you what to do,
I'd lay down all my gamblin', an' work on the building, too.

If I was a 'ho'-munger, I tell you what to do,
I'd lay down all my munglin' and work on the building, too.

I'M WORKING ON A BUILDING- Carter Family

                   I'm working on a building
                   I'm working on a building
                   I'm working on a building
                   For my lord, for my lord
                   It's a holy ghost building
                   It's a holy ghost building
                   It's a holy ghost building
                   For my lord, for my lord

               If I was a liar
               I tell you what I would do
               I would quit my lying
               And work on the building too

                   I'm working on a building
                   I'm working on a building
                   I'm working on a building
                   For my lord, for my lord
                   It's a holy ghost building
                   It's a holy ghost building
                   It's a holy ghost building
                   For my lord, for my lord   [INSTRUMENTAL BREAK]

               If I was a drunkard
               I'll tell you what I would do,
               I would quit my drinking
               And work on the building too

                   I'm working on a building
                   I'm working on a building
                   I'm working on a building
                   For my lord, for my lord
                   It's a holy ghost building
                   It's a holy ghost building
                   It's a holy ghost building
                   For my lord, for my lord   [INSTRUMENTAL BREAK]
               
               If I was a preacher
               Tell you what I would do,
               I would keep on preaching
               And work on the building too

                   I'm working on a building
                   I'm working on a building
                   I'm working on a building
                   For my lord, for my lord
                   It's a holy ghost building
                   It's a holy ghost building
                   It's a holy ghost building
                   For my lord, for my lord