I hear the line in the second verse as "I guess the wise folks ought to know" which sounds much more likely for a commercial recording (Jimmy Rodgers B side) and having known Driftwood. That's commercial folksinger Jimmy Rodgers not the Singing Brakeman.