I don't know that we should dismiss druidic connections totally. The true (historical) druids were Celtic, were given a bad press and wiped out by the Romans and therefore not too far back in time.

Their language was presumably closely related to Welsh (rather than the Q-celtic of Ireland), and Westmorland could have been in the right area to have a similar dialect.

(The modern druids have no connection, of course)