Like Stu I don't think you can hope to stop it, but I do think it's impolite. All I can suggest is give it some thought and see if you can find a way to deter folks from fiddling while you're on stage.