This sounds familiar. Treat it as a personality quirk and pay it no heed. I know a man like that and he's the same with driving when I give him a lift home. Any time he says turn left I turn right by instinct. He's got the message more or less.
Sooner or later your friend is going to try it on soemone with a short fuse, or who's had a bad day, and he'll be chucked half across the room.
In the meantime though, there's no need to quarrel. Just let him know you aren't taking any notice of his controllery.