Did he provide any proof? Possibly someone complained, and your address was in the message header(s) - but that doesn't mean you sent it. The header can be faked, after being picked up from addresses on someone else's machine.