If the rock is clean, i don't think it would hurt the fish. I have seen some rocks be hurt by the aquarium environment, I'm not sure if the water is too acidic or if it's the fish poo, nitrates, phosphates, etc. But some types of rock can be damaged in that type of environment.
I'd guess nice, translucent material like that would be better than chalky materials.
Joshua