GFOR,
Has he withdrawn from you emotionally in general, or is it confined to a withdrawal of his physical intimacy? Are you getting fulfilled in plenty of other ways, or is it all pretty bleak? I hate to be the one to bring this up, but some men really are monogamous and/or guilt-ridden and withdraw from their spouses if they are having an affair.

John