It's All Black and White (and Yellow?)

I recently acquired a black hat reminiscent of the one the Gorton’s Fisherman wears, except this one is black. I’m in a weird mood tonight and can’t help making some random associations.
In the old cowboy movies, you can tell who the good guys are because they wear white hats. Likewise, you call tell the bad guys because they wear black hats. So what’s up with the Gorton’s Fisherman and his yellow hat?
All I can figure is that he’s one of the good guys and he had a run-in with Clifford the big red dog. (At the very least, he must have been attacked with a bucket of lemonade!)