Well there might have been other reasons for the prohibition against eating oysters. I'm afraid it wouldn't be gentlemanly to go into it too much in depth, but suffice to say, it could relate in some way to the whole forbidden fruit idea, allegorically speaking.
Oh for shame!