What can be really annoying is when you write something correctly, and it gets "corrected" into something that is wrong - especially when the computer does the "correcting".
I don't think anyone has pointed out that "the hoi polloi" , which has turned up in at least one post, is strictly speaking a solecism, since hoi means the, so you are saying "the the many". But that's one case where I tend to think the wrong version actually sits better in English than the right one.
There's a distinction between mistakes that don't mess up the meaning, and those which do - such as the one demonstrated in the title of "eats, shoots and leaves".
The one time perhaps when it's always justified to be a stickler for accuracy is when picking up grammatical or syntactical errors made in the course of correcting others.