I've got a climbing skull cap from black diamond for use under climbing helmets that I often use under a ball cap. It really shines when doing things like biking in the winter, but I use it while fishing often.
Edit: the hat is the black diamond dome beanie