But then the other guy would say it too, and you'd be back to square one.

I have seen the occasional political debate where a politician has responded to some impassioned onslaught by saying "I agree" and sitting down. The effect can be so disorientating that its rather like the bit in a film where someone is charging at a door, and the person inside opens it wide, and the other guy runs through and falls out the window.