Fugitive Slave Law was law in large part because Fillmore pushed hard for it himself, in order to try to satisfy the South. Obviously it's a matter of perspective--as a black, how would you have felt about it? Also, Dred Scott decision was not under Fillmore.