I have more trouble linguistically with "why my heart is broke"!

I used to sing this when I was a kid, and had bought the sheet music after hearing a visiting African-American mezzo-soprano sing it as the encore in a classical concert. I'm not sure where the music migrated to, but memory throws up another verse:

Go on your way, be happy
Go on your way and rest
Remember that you were the one
I really did love best

I also remember it as "give you back your letters".