In the US, I don't think we even have the option of paying taxes at a bank. I've never heard of anyone doing that. I suppose you could go to the bank and arrange for a wire transfer, but the bank would charge for that service, way more than the cost of a postage stamp.