Mystery solved, I think. The first lyrics posted in the thread had the chorus as:

Hurry home sweet daddy, and don't you take your time
If you wait too long your mama will be gone

Jim Dixon, who is legendarily accurate, has:

Hurry down sweet Daddy, come blowin' your horn
If you come too late your mama will be gone

And that's what the Digital Tradition has, too.

I found the song on the album Jim Kweskin & the Jug Band Greatest Hits!, and the singer sounds like Maria Muldaur. She sings "don't take your time." John Hurt sings "blowin' your horn."
Q.E.D.

Kweskin Recording: https://www.youtube.com/watch?v=zi5-98RovOQ - and it's really, really good.