Just leave him to it with a sigh while raising your eyebrows. Then ,as patronisingly as possible and pretending that you are trying to smile indulgently, go to the bar and stay there until you embarrass him into going away away
That's what they always do to shut me up.