Have a look at http://www.workingclasslit.com/?q=socialist_hymns/book
(sorry, I'm a Blueclicky-atheist!)
It is a page by page scan of the ILP's Labour and Socialist Hymns. A few of them do mention God, but most don't.