Shambles said it. "We get irritated with many people for many reasons." Sometimes it may be because they are saying things that challenge us because they have more integrity than we feel comefortable.
But sometimes that has nothing to do with the reasons they drive us screaming mad...