It's been years since I heard it, but the lyrics are something like this. I've bracketed phrases I'm not sure about. Maybe this will jog the memory of someone else who knows it.

Once in my youth[as a child]
I stood on this mountain
And planted some pines in the sand.
Every day, I'd look their way
And I just couldn't understand
Why they never grew like I thought they should do
I just couldn't understand why
Now I've been all around this whole wide world
And today, I just happened [was just passing] by

chorus (as Ely lists above)

[I still can recall] the day that I left
The hum of the bees in the hive
The faster I walked
The louder they talked
[How lonesome it seems here today]
There's that old [stone fence]
We built inch by inch
Surrounding the old family grave
(Sorry, I don't remember this line-It's something about all family and friends now in the grave)

It's a great song, reminiscent of "Rank Strangers", and I'm sorry I can't give it all. Hope this helps.