I just finished reading Freethinkers. It's work, be warned.

When I was growing up in a moslem/catholic country, those of us who weren't moslem were, absolutely, considered infidels by the moslems.