Yes, fellow officers rode with Lee, but the song is supposed to be the viewpoint of a "common" Southerner, not an officer or a "privileged" Southerner. I could have phrased that more clearly.