The closest I ever heard was the reason Sue Barker kicked him out - she had a latex skirt prepared, talced and polished, and when she got back it had been tried on. He was the only one with a key to the room.
But a minor rubber fetish is a mile from this. But it was about the time this is alleged.