To update, I have done some explorations in the cave with a friend of mine. It's a steep climb (or slide) down the muddy entrance of the cave probably close to a 45 degree angle. The very top is like this but as you get deeper in the cave, you start to see the rock, but at points it has a thick layer of mud. Once you get to the bottom of that you are at the shore of the lake, but if you turn around, you notice that it looks like where you just came down was steps. I say this because although they are a good bit washed out, you can still see the stair layout.
When I was at the shore I looked around and found the average kind of graffiti but with closer inspection I found a really nice one from 1942, another one we weren't sure about that said 1915 or 1815 (written in charcoal), on the ceiling there was a complete trilobite, a spiral that could of been the trilobite fossil without the shell or possible carved, and finally there was something next to the trilobite that looked like a very simple carving of a snake.
After the trip we found all of this, we came back with a raft. We tied the raft to the shore and paddled out which might I say is a little scary considering the circumstances. So we didn't really notice anything other than a few geological formations while we were out on the lake. At the back of the cave we hit another patch of land. It's ceiling is a lot lower so its a crouch. We didn't go far back at this point because there was what looked like sulphur (yellow, chalky, small yellow dots all over the place). We did notice some more graffiti which was interesting because one was clearly 1847. So with what little time we spent back there we saw a small one seater boat that was split right down the middle, laying near the shore. There was a small stream coming from a hole in the wall, which I've been told if you crawl through, you come to another lake. The only other thing of note that we saw (which is mostly just spooky) was we saw a fresh foot print heading to the back of the cave but not one coming back and a broken hypodermic needle.
I have intentions of going back, a little more prepared, and exploring the back of the cave. Any suggestions of what I should be looking for or things I might have missed. Also nearing the end of our last trip into the cave we all started smelling something like paint or paint thinner, if anybody knows what might cause that please tell.