apply for a variance ... you may still win your case, and your neighbor will have nothing to say ...