If I remember aright, the South offered to free any slave who would fight for it -- 1865, way, way too late to do any good.
Remember also that owners would sometimes contract out the work of their slaves, and that this was done in the South during the War, especially in constructing fortifications, etc.