Consider this. What the north wanted the south to do was to give up their most valuable assets. Slaves. How would we react if the government demanded that we give up our equity in our homes?
Clearly the north forced them into a corner and they felt they had no choice but to fight. Just as Japan did when FDR froze their assets in the USA.
There are plenty of "brown" sandwiches to go around.