The upper classes have been abandoning their children for someone else to look after from an early age for years.

Somehow it never counts as abandoning children when they do it.