"Passum" is the participle of the verb "patior". In Classical Latin it means not just "to suffer", as something painful or bad, but it has a neuter meaning of being the target of an action or experiencing something. In this late Latin usage it acquires the negative meaning, like in the expression "The Passion of Christ" (passus-passion, same root).