Google "soiled doves" and a lot of information is available, particularly about soiled doves of the old west which is where I believe the expression came from.