I think Barnard Castle in Teesdale might be a candidate. Varnet was created Earl Barnard because his family took the place. A quick google should give you the family details.