You seem to have considered all the possibilities with the exception of air source heating - I got a mailer from my electricity supplier about it the other day (think it's EDL). They do a free survey.

Boiler Juice is a good place to get competitive quotes for your oil (don't get tied into a regular monthly payment contract - in my experience it's a ripoff). LPG is horrendously expensive.