FWIW, if it really was "Pittsburg", it was the Texas one. (There was a Civil War battle there, too.) The Pittsburgh in Pennsylvania has an h on it (& thereby hangs a tale).

OTOH, "Pittsburg" for "Vicksburg" is a pretty likely mishearing.