At last I know something useful! I once heard Malvina Reynolds herself say that the song referred to the neat rows of houses you can still see on the hillsides and tops as you head south (?) out of San Francisco towards the airport. The colors give it away. From the highway, that was the only way you could tell one from another.