It makes it an increased offense against those abused if there is some kind of bizzare 'well it's less bad if it's a woman' thinking...
Having said that, I don't know what we can do with abusers and seriously neglectfull parents. My instinct would be to sterilise those who repeatedly demonstrate neglect, and permenently incarcerate those who sexually re-offend.
And me a libertarian and all.
I do however take the rights and liberties of those who are innocent to be of far far greater importance than those who would wrongfully and knowingly infringe upon them...