I think "baby daddy" is really a pronunciation of "baby's daddy". It doesn't bother me.

What I really hate is cat or dog owners being referred to as the animal's mummy or daddy - yuck.