Ummmm, from the angle of the second picture, it looks actually like a vertebrae from something. If it's old enough, been outside in the elements long enough, or even if the creature had some type of disease, it could make it look like it's made from sandstone.
Keep in mind, I'm NOT a doctor, just going by the second picture and the odd shape of it that resembles a vertebrae in my eyes.
