Not all large sizes are due to 'gluttony' many are simply due to height, shoe size etc.
There was an interview with a spokesman from M&S (the 'offending' store on the radio recently; he made a good case based on the need for extra engineering etc as described by jacqui above.