Not quite "Non-Music", either; Michael Mantler recorded a series of Gorey's poems set to music on The Hapless Child and Other Inscrutable Stories (Virgin/Watt Records WATT4, 1976) featuring, among others, Carla Bley and Terje Rypdal, with Robert Wyatt doing the singing.  Quite extraordinary!

Malcolm