I'll quote the lyrics with different line divisions and puctuation marks.

THE CAVALIER'S GLEE
By Captain Blackford, of General Stuart's Staff
Air: The Pirate's Glee

1. Spur on, Spur on, we love the bounding
Of barbs that bear us to the fray;
"The Charge" our bugles now are sounding,
And our bold Stuart leads the way.

CHORUS: The path of honor lies before us,
Our hated foeman gathers fast,
At home bright eyes are sparkling for us,
And we'll defend them to the last.

2. Spur on, Spur on, we love the rushing
Of steeds that spurn the turf they tread;
We'll through the Northern ranks go crushing,
With our proud battle-flag o'erhead. CHORUS

3. Spur on, Spur on, we love the flashing
Of blades that battle to be free;
'Tis for our sunny South they're clashing,
For household gods and liberty. CHORUS

SOURCE: American War Songs, published under supervision of National Committee for the Preservation of Existing Records of the National Society of the Colonial Dames of America (Philadelphia; Privately printed, 1925), pp. 135-136 (words only)

That soldiers also sang the original ("The Pirate's Glee") was recorded in John H. Worsham, One of Jackson's Foot Cavalry (1912):

"We marched out of camp singing, and kept it up until we arrived at the front. While we were singing the 'Pirate's Glee,' and were well in the chorus, every man having joined in with a zest, and had taken up the inspiring words, 'We'll nail the black flag to the mast,' we came suddenly on Gen. Jackson. He pulled off his cap, and his eyes twinkled with evident delight as we passed."(p. 59)

The "Pirate's Glee" mentioned here is in The Lester S. Levy Collection of Sheet Music as:

Title: Blow On! Blow On! The Pirates Glee!
Composer, Lyricist, Arranger: Words by Arthur Morrill, Esq. Music Composed by Benjamin F. Baker.
Publication: Boston: Geo. P. Reed & Co., 13 Tremont St., 1840.
Form of Composition: strophic
Instrumentation: piano and voice (ttbb chorus)
First Line: Blow on! blow on! We love the howling of winds that waft us oe'r the sea
Dedicatee: Respectfully dedicated to the Salem Glee Club

~Masato