I've wondered the same thing: When I'm vacuuming, why does the pleco freak out, while the guppies come taste my arm?
I would guess that a part of it is that plecos are more "wild" than some of the other fish, that have been in captivity forever. But this seems only true in a few cases.