For some people the British Royal Family have always been seen as a bit common, or rather, "middle class" (well, since the Hanoverians came in anyway). I think one problem with Diana was a sense she had "married beneath her".