"That's like saying it doesn't matter if you support Manchester United or Manchester City.

Either way you've got something in common underlying the rivalry which isn't shared with people who aren't in the least interested in football. Opponents are part of the same game, in any field.