Roger, in your lucid moments I'm sure you recognize that Joe's "abuse" of you is recent. For many, many months he stayed calm if occasionally bemused or somewhat exasperated as he tried to explain to you what you will not accept. Only lately has he given up on you.

IMO it's time for you to back off and regroup.