The letter 'thorn' is written as þ (hope this works in HTML - it's a p with the round bit slipping lower down the stem) with a 'th' sound. Handwriting development in the 12th and 13th centuries led to the 'thorn' and 'y' being written as the same letter and therefore interchanged, so often þe was written as ye.