When you're looking for a shape note hymn, a good bet is the Sacred Harp songbook. It indexed in various ways, including by words included in the songs at:

http://fasola.org/index/0Index.html
I looked there under the word "drive" and found the following, apparently the original from which the "remnant" came. Interesting to compare the original (if so this is) with the recorded version linked by Michael Dougals, above.

[98 refers to the page number in the 1991 Revision of THE SACRED HARP

DULL CARE 98 ]
Tune: E. J. King, 1844
Meter: Common Meter (8,6,8,6)

Why should we at our lot complain,
Or grieve at our distress?
Some think if they could riches gain,
They'd gain true happiness.

Chorus:
Ah! we're much to blame,
We're all the same --
Alike we're made of clay;
Then, since we have a Savior dear,
Let's drive all care away.

Why should the rich despise the poor?
Why should the poor repine?
A little time will make us all
In equal friendship join.

(Chorus)

The only circumstance of life
That ever I could find
To soften cares and temper strife
Was a contented mind;

Chorus:

When we've this in store,
We have much more,
Than wealth could e'er convey;
Then, since we have a Savior dear,
Let's drive all care away.

When age, old creeping age comes on,
And we are young no more,
Let's all repent the sins we've done,
Nor grieve that youth is o'er;

Chorus:

We'll more faithful be
Than formerly,
And constantly to pray;
Then, since we have a Savior dear,
Let's drive all care away.