Try scraping it with a razor blade. Rub some vinegar into it, then use the blade to scrape the deposits off. Just be sure to keep the blade at a steady angle to avoid scratching the glass. I cleaned all my tanks like this when I had them empty to move them, and it worked wonderfully. I have hard water myself, and my tanks had gotten really grimy with mineral deposits.