Yep, made to lay on their side because they had a cork stopper. By laying on their side it kept the cork wet and swelled. Otherwise the cork would dry out and shrink, and lose the seal.
XR.... The term "pop" bottle was actually from these soda bottles, with some sort of glass ball, or marble looking ball in the top of the bottle. The carbonated drink would keep the pressure on the ball and hold the seal. You would have to literally "pop" the bottom of the bottle to jar the seal loose...... Here's some samples. https://www.google.com/search?q=antique+"pop"+bottles&source=lnms&tbm=isch&sa=X&ved=0ahUKEwjvorjo59PYAhXI44MKHdl2DfAQ_AUICygC&biw=1014&bih=673#imgrc=su2nZgFy-nTvjM: