The New Georgia Encyclopedia suggests that the name came from the Greek "kuklos", meaning circle, but origin not really known.
Confederate General Nathan Bedford Forrest was the first Grand Wizard, in 1868.
Article on the early Klan:
http://www.georgiaencyclopedia.org/nge/Article.jsp?id=h-694