"Cult" just means you don't agree with what they believe and do, and there aren't enough of them to use lawsuits or the criminal justice system to shut you up.
Get postmodern about it. The word only makes sense in terms of the power wielded by those who define social categories.