Sometimes there are other factors at play.
I had to basically give up on one of my favorite runs. I would access the water legally, cross the river and then hike the gravel bar, waaaay below high water mark, to the top and start fishing. I did this for a couple seasons before I ever got yelled at, then one day a guy came out of his house from across the river and started going berserk. I knew I was legal so I calmly explained to him how I got there. Not good enough, he called the sheriff. Sheriff came, got my side of the story and said I was legal and to leave me alone. Couple weeks later the exact same scenario, even the same deputy. Once again, guy was told I was okay and to leave me alone.
Gave that spot a rest for the season but the next fall gave it a go again. Before I even started fishing the guy comes running out. he had put up cameras and was going to show the cops! Well, fine by me. Sheriff comes, same guy as last year and he remembered the deal. Offered to write the guy up for harassment. I said no, just please get him to stop. Sheriff leaves and guy starts driving up and down the road pointing at me. Super weird. Eventually he goes home and I finish fishing. As I'm standing at my truck derigging a nice old couple pulls out of the closest driveway. They stop and ask if so and so has been giving me a hard time. I tell them the scoop. They apologize, the guy was their son who lived on the corner of their property. Turns out the guy was a Vietnam vet and had mental issues. That just sucks all the way around and I definitely don't want to trigger the poor guy so I gave up that spot.
But man do I miss that run.