In general you can't tell an orthodox Jewish yarmulke from a Muslim skullcap

And the Pope wears one too.

I'm reminded of the bit in the film Witness where the Amish boy runs into some Hasidic Jews and assumes they must be Amish.