"I'm sorry if you took offense because I didn't say what you thought I said, and if you were listening you would have known that."

Would that do? :)