If it had been the symmetrical Confederate flag he was flying upside down this problem wouldn't have arisen either. Though I suppose other problems might have.

Anyway, haven't there been Supreme Court decisions which would indicate that this kind of thing counts as an exercise of free speech?