There is a site with San Francisco songs, including "Little Boxes." Daly City
According to this site, "Legend has it that she looked up at a pastel-colored Daly City hill-side and said to her husband...etc." Only legend? Probably so. Pete Seeger met Reynolds in 1947; the album "we Shall Overcome" with Pete Seeger singing the song was released in 1963.