You can switch the transmitter off or mute it quite easily though.
Cheap headset mics can sound horrid and give you problems (dropping out, bursts of noise, interference). If your're going to get one invest in a good make of UHF mic. We got a Sennheiser EW100-G2 set and have not regretted it. Festival sound men love it.