The various Myst games have beautiful scenery, ingenious puzzles and often "rides" around an area as a reward. There are also several adventures by Lighthouse Games that have the same style, Barrow Hill, and Lights Out come to mind.

Most of the Elder Scrolls games have good first person views of scenery. If you fancy something less fantasy-oriented, KotOR and Mass Effect are great Sci-fi adventures, Though if you hang about in space planet-gazing you will probably be blown to tiny pieces :(