Is there any natural toxicity in an edible clam?

Me and my father were sharing steamed clams when he told me that the dark "skin" inside the clams was toxic and should not be eaten. Any truth behind that?