It’s definitely pottery, What’s throwing I’m is such a tight curve the only thing I can think of that round would be a pipe.
I seriously doubt it’s an accidental fired clay because it’s found in limestone rubble up on a bluff under an overhang. Also no daub or burned earth anywhere.