"Your prison is walking" is the wording that's in Rise Up Singing, which is a reasonably (but not completely) reliable source. I didn't find it in any of the fakebooks I have, and I have a good number of them. In the Judy Collins recording, it sure sounds like "your prison is walking" to me. Haven't found the Eagles recording of it, yet.
-Joe-