Knowledge of geology and minerology, use of effective prospecting methods, diligence and hard work. Rarely "just by looking" or just by luck.
--Dave J.
Custom, there is no "the answer". We're not holding out on you.
If your inquiry is about finding possible gems on property you own, you need to get out there and cover it thoroughly on foot. However for that to do any good, you need to know how to identify rocks and minerals, geological formations, and to visualize the geological processes that led to the present conditions.
"Effective prospecting methods" depends on the nature of the site, the kinds of things you're looking for, how much time you've got, and how much money you've got. There are many. There is no method specific to locating "gems" in the ground where they are not already known to exist, since "gems" are many different kinds of things that form in many different rock types and geological settings. Where they are already known to exist, the most common method is pick and shovel; or if running water is available, sluicing and panning.
If by "gems" you include semiprecious stones, such are of widespread occurrence and there's a good chance such are to be found on your property if it's rocky (as opposed to riverbottom silt for instance). If all you want to do is a little rockhounding as a hobby that's one thing. However when you talk about sinking shafts into the ground that's an economic activity which requires capital investment and dealing with government regulations. And, unless you're mining investors rather than gems, you've gotta have enough gems and you have to know how to sell them at a price high enough to cover your costs. Mining is hard dirty work and there are a lot more ways to lose your shirt doing it than there are ways to make money at it.
If dreams of gem mining have bitten, you've got years of book-learning and research and listening to old-timers ahead of you. Plus hard work and getting dirty. You might also join a local rockhounding club where other members can give you a bit more information on local geology and show you some rocks and minerals to give you some practice identifying them.
--Dave J.