Also depends how far back:-

Lord Liverpool - presided over the era of Peterloo and the Corn Laws.

Lord John Russell - disastrous response to the Irish potato famine.

The Duke of Wellington's stint as Pm was also pretty disastrous though he did enable the Catholic Emancipation Act as I recall