The song is on Smithsonian/Folkways album SF 40009, Elizabeth Cotten: Freight Train and Other North Carolina Folk Songs and Tunes. Here are the lyrics from the CD booklet (which I think is wrong about "women"):

OH BABE IT AIN'T NO LIE
An unusual blues sung around the Chapel Hill area

One old women Lord in this town
Keeps a-telling her lies on me.
Wish to my soul that old women would die
Keeps a-telling her lies on me.

CHORUS:
Oh babe it ain't no lie,
Oh babe it ain't no lie,
Oh babe it ain't no lie,
Know this life I'm living is very high.

Been all around this whole round world,
Lord I just got back today.
Work all the week, hon and I give it all to you,
Honey baby what more can I do?

https://www.youtube.com/watch?v=6GFM6B0oQ8M

Here's a live performance - you gotta see this!

https://www.youtube.com/watch?v=FhQLxGmU4QA