Depends on the metal that's rusting but no matter what it is it will not be a good thing. Stainless is just a mixture of steel and chromium AFAIK
. Some metals may not cause damage to animal health but can fuel nasty algaes like no tomorrow.
Personally I would remove anything that rusts or seal necessary items with silicone prior to use as a preventative measure where there is no choice.