So is everyone avoiding the "meaning"? Sounds like it means cheating or being unfaithful. The cuckold says it of the lover, "he's been etc.." but the implication is that his woman is being unfaithful. The image of her body as a potato bed being "gardened" is sexist at best. When Bill Broonzy sings it as "digging my potatoes", the sense of infidelity becomes confused. I think the jury is still out, and a certain prudery infects the Internet, I think. Do a search and you'll find quite different meanings suggested .