The great thing about lemon juice, vinegar, or a citric acid solution is that if you get a bit in the tank you'll probably be ok. You can even feed orange pieces to goldfish* so citric acid and lemon would be quite safe as long as you didn't go squirting some into the tank.
On the other hand...