Here's another vote for Heart Songs. I did it a little differently though.   I gave away the reprint and kept the original. Another worth having, though it is usually in poorer shape than Heart Songs is Songs That Never Grow Old, also copyright 1909. Finally, there's the New Blue Book of Favorite Songs, all three can be found quite reasonably priced. If you pay more than $15 for any of them, you're almost certainly paying too much.

Hymnals ~~ I mostly rely on two, Heavenly Highways Hymns and its immediate Stamps-Baxter predecessor, Favorite Songs and Hymns, 1939.