"My country, right or wrong" is a thing no patriot would think of saying, except in a desperate case. It is like saying "My mother, drunk or sober".
G.K.Chesterton, from an essay he wrote called "A defence of Patriotism" - in this case the patriotism he was defended involved campaigning actively against his country England's involvement in an unjust and popular war.
The point he was making is that the more you love your country, the more you will try to stop it going wrong.
And here's another quote which is really saying something similar, using a district in London as an example:
"It is not enough for a man to disapprove of Pimlico: in that case he will merely cut his throat, or move to Chelsea. Nor certainly is it enough for a man to approve of Pimlico: for then it will remain Pimlico, which would be awful. The only way out of it seems to be for somebody to love Pimlico...as mothers love children, arbitrarily, because it isntheirs."
And if you love someone you do your damnedest to help them avoid mistakes. And to pick up the pieces when they do make mistakes.