I always understood the holly to be a plant metaphor for Jesus and the ivy is Mary--or their non-Christian equivalents. There is a similar song in Oxford Book of Carols called Furry Day Carol from Cornwall.