I think that what puts people off about Dylan's voice is the timbre, which is something one's born with and cannot change, otherwise his singing is spot on pitch and note perfect. This is according to a music professor I once heard on a NPR show, I myself am a non-singer but have always liked the sound of his voice.