My favourite collection is probably 'Frank's Wild Years', with its powerful songs like 'Innocent When You Dream' and 'Cold, Cold Ground', but I am also fond of the stark performances in the two 'Early Years' collections from Bizarre/Straight, with mostly piano or acoustic guitar backings.
--Stewie.