Lyrics were posted in an old thread called Lyr Req: 4 Wet Pigs (which happens to be another song that Bryan Bowers recorded, though he didn't write it). The person who posted it called it STATELY MANSION (singular). Since it's hard to find there, I'll copy it here:

STATELY MANSIONS
Bryan Bowers

I was once a stately mansion
Back around Civil War time.
Hard times they have fallen on me.
Now I am past my prime.

That day the owner left for war,
It seemed as if my world was reeling.
The South lost, though Lord knows she tried,
And now my paint is cracked and peeling.

Now my boards are bare, and who's to care?
My yard is overgrown. My roof is old.
To children, I am haunted. To myself, I am tired.
I'm just an old wood house down the road.

I'm just an old wood house down the road.

[Sung by Bryan Bowers on "Home, Home on the Road," Flying Fish CD #91, 1980. Allmusic.com doesn't list any other recordings.]