As Steve says, difficult to ban it completely. But restrict to organised displays, and for the UK at least, keep it to November 5th, whatever day of the week it falls on, rather than have a week or more of nightly big bangs and animal mayhem!
(Says she, who lives in Edinburgh, where they have very bangy fireworks at the end of every Tattoo performance for a few minutes, then the Festival fireworks concert, lasting 45 minutes, and a huge display at Hogmanay too!)
However, sticking to set dates at least allows animal owners to take any necessary precautions for their pets.