Nope. "Hoi polloi" is an English word and takes an article. If I were speaking Greek I wouldn't use an English article because, well, I'd be speaking Greek. When I'm speaking English I treat a word the way the English language treats it.
Don't confuse meaning with etymology.
O..O
=o=