...the 'right' to exploit other people for their own economic gain.

Surely that wasn't a point of difference between the two sides? There were two different ideas about how exploitation ought to be done, with the chattel slavery one being even nastier than the other.

I think only one side thought of it as a right.