Doesn't it mean "when we are no more". As in no longer conscious. He's talking about the eternity of nature compared to our own mortality. The world is already old when we are young, it's been around for thousands of years, and will be around for thousands more after we "lie cold" in our graves and "lack will" ie sentience, after we're dead. That's how I read it.