Off the top of my nut, I'd say that our feelings are indeed the key to it, as such theology would seem to arise as a concerted reaction to the same basic primal / lustful / instinctive impulse that you speak of; one which in the Abrahamic tradition is defined as the 'sin' with which we are in constant struggle, both actual & metaphorical.

In the Gnostic tradition they went as far as to see it as part and parcel of the material creation of Lucifer, ideas which we see expressed today in terms of the Nature / Nurture dialectic and, perhaps, writ large on the (invariably) tormented faces of the Green Men themselves.

So in one sense, yes, absolutely; the Green Man does represent that very same impulse, albeit in terms of dire warning as to the consequences of allowing oneself to become thus beguiled in the green-wood; especially those of the cloistered Holy Orders, to whom the green men were primarily addressed.