Guilty. We say those things too.

Well, some of us.

When I was in England, I found use of the phrase "go to the toilet" a little embarrassing.

Here, a "toilet" is specifically the commode, rarely the little room.

It's often heard in the phrase "on the toilet."