The story in Goldman's Lenny Bruce biog, I seem to remember was that Lenny stole Tim Hardin's girlfriend - Fay Dunaway. Something like that. Could have been vice versa.
In the Red Balloon song, Derek Brimstone reckoned the - 'it stole the lovelight from my eyes' - was a reference to the heroin addiction making him impotent.