No, it is the silica raising the silicates, which are why it is brown algae instead of a different type.
This the problem with pool filter sand, play sand, etc. I use Estes' Ultra Reef which is silica based but has a polymer coating to prevent this exact problem.
As long as the conditions favor it, the brown algae will stay. What fish are in there? You may just want to add a bristlenose pleco.