I use my 9.5' raft as a pram and I like to drop the stern anchor (25#) first and then let the boat swing where the wind is going to put it. This puts the wind to my back. I have a swivel seat so can fish anyway I want, but I prefer the wind to the regular rower's back and fish looking out the front. Once the boat is done doing it's thing I'll drop the bow anchor (10#).
Not sure if you're doing this, but I've been guilty of rushing the bow anchor sometimes. I mean, there's fish to catch right?
Taking the time to let the boat "settle" with the prevailing (if there is such a thing at the time) wind before getting that bow anchor out has reduced my frustration. Also, and maybe this is just my raft, have a bit more stern line out than you think you should have. I know lots of guys like that stern line to be dropping straight down/tight. That might be fine in a little pram (would be a bow line for a pram), but I think the bigger boats do better with a bit more line out the back. If the wind is strong or gusting you need more out anyway to hold better. You'll get blown off over and over if your stern line is too short.
The bow line can be straight down. Of course, in a drift boat with a swivel seat or recliner or whatever you got

,you can pick which is stern and which is bow as
@Old406Kid &
@troutpocket have mentioned. You have some options.
Good luck!