they "treated them like family"

Well, the majority surely weren't considered "family" to the degree that their owner-progenitors would set them free- they were still bought & sold like cattle regardless of being half-brothers/sisters, sons/daughters, etc.

Manumission of slaves because they were blood relatives was very much the exception rather than the rule.