Mudlark, I think you're right about it being a reflection and that particles in the atmosphere act as a sort of mirror.

Venus - it has to do with where in its orbit it is, and its relationship with Earth's orbit. I'd guess that a Venusian year is longer than an Earth year, so it wouldn't be visible all the time. Mars is pretty cool too. It shows up as a really bright red star.