It's not the quality but the difference. I'd rather listen to Phil Spector than Burl Ives, but the latter just stood out.
Mind you, a bit later on they put on Arthur Conley's "Sweet soul music", and that sounded pretty different too (also in a good way).