Why were they called "holystones"?

I read somewhere that it was because the sailors were down on their knees (like praying) when they used them.