Oh boy...Buzzy has led us into the MTB tire discussion...aka blackhole. Politics might be easier to talk about than MTB tire preference.
You have standard 26" MTB tires so they will feel squirrely on gravel if they are pumped hard. You probably also have standard tubes so you don't want to air down too much or you might end up with a pinch flat. Having said that, if they are rock hard take some out. You should be plenty safe from pinch flats if they have 30-40 pounds in them. If you think you can take them down even more, in the 25 lb range without hitting rim try it.
If that gravel still feels "squirrely" then off-road may not be for you. With MTBs you're never really "sticking to the trail" or road. It's more of a float/slide thing. And always use front AND back brakes when you really need to stop. Otherwise you won't stop in time of that log or fence or gate or hiker. Or dog! Don't get me started on that topic. Biking dogs are worse than fishing dogs.... I'll stop.
If your bike will take bigger tires I would highly recommend it. You'll have more traction (so more braking) and more comfort if you can get up to 2.1 or even 2.3.
You've opened Pandora's box with this one. Haha!