Some give a derivation from the expression Gardy Loo (= French gardez l'eau) used as a shouted warning when hurling the contents of a full chamber pot out of the window in the morning. Others suggest an origin in "le o o", a reference to French outdoor privies having the symbol of two small holes cut in the door. (o o).
There may be other ideas.