The analogy is that if someone has a "bee in their bonnet" about something (blood sports or minstrelsy) they can choose to pick on an innocent part of someone's "kit" and make a fuss about it whether there is a connection or not.