Apparently, I was wrong about the not being a cult if it's small or unpopular thing. The definition I found on line is "a system of religious veneration and devotion directed toward a particular figure or object.
A relatively small group of people having religious beliefs or practices regarded by others as strange or sinister."