I guess it comes down to just how clumsy you plan on being. Waterproof cameras will generally cost roughly twice what you could get a regular camera for ($110 - $130) Drop it once your about even, drop it twice you're behind in cost.
Some of the best cameras are in the Canon A series. I would caution against getting a camera that doesn't take normal AA or AAA batteries. A camera doesn't help if you find your batteries are low and your stuck with a funky battery type you can just get a the gas station.
Another point is that if your just going to use it to take pictures of fish, and some scenery, don't feel you have to get a high number of megapixels. It will bump the cost with very little benefit.
Tim pointed out some good review sites. Check out what they have to say about low light shooting. Some cameras struggle in low light focusing; which with a fish in one hand and a camera in the other, may not make getting that picture at dawn or dusk that easy.
When on the water, always ziplock bag your camera anyway.
I suggest www.newegg.com for reviews and camera.
Good luck.