Ah, well, I guess maybe you don't love him. :-) When one dearly loves a person, one is naturally quite interested in what they have to say...
Love can take many forms, quite apart from the romantic form. Bob Dylan is loved by many because his songs deeply changed their lives. It was that very love, badly mishandled by a certain number of immature people, which turned his public and private life into a nightmare.