Joe Offer wrote: let's say I'm using Audacity - would a USB microphone bypass the sound card and go straight to Audacity?

A microphone is an anologue device, as are speakers, but a computer is digital. The sound card has analogue to digital and digital to analogue convertors, to connect everything together. It would need the sound card.