Hoi (or rather "oi" with a rough breathing) meant "the. So "the hoi polloi" is a solecism.