There's The Battle Hymn of The Republic of course. There's also a hymn called "Hold the Fort", inspired by Sherman's march. I think, "Babylon Is Fallen" is also inspired by the defeat of the confederacy.