I am NOT afraid of the three things I COULD catch from a fish or from my dog eating off my ice cream. Otherwise I'd have a massive air system and never leave my house. The world is a disgusting place...all I can do is pray my immune system is up to the task!
This is right on... it's not only human activity that spreads disease (Although it sure seems to promote it) but everything around us. From the beetles that carry tapeworm juveniles to our dogs. Proper washing of hands probably will take care of most of the things that you would need to worry about (Both in the fish tank and in the "world"). Like Christmasfish said, if you were worried about everything that could infect you, you might as well live your life in a bubble and hope nothing can get to you. For those of us not willing to do this, as long as we take precautions like washing hands after being in the tank water, it should be okay...