Tailors were always rather suspect (and probably envied) for the access that they enjoyed to women's chambers. Added to that the fact that their job required them to do a lot of sewing, which was very much a ladies job - you can understand why they were rather reviled.