Rime of the Ancient Mariner - I have a copy with the original Gustav Dore illustrations. I don't know which I like better, the poem or the pictures.

Jabberwockie is the only poem I know by heart, not including really short Ogden Nash poems.   

The Highwayman is another favorite.

Anything by Robert Service.