If it is brown, it is almost certainly diatoms (which are commonly, though incorrectly, called "brown algae"). They are perfectly normal, especially in a new tank setup, and are harmless though they can be unsightly.
You can clean them off manually, or the other option is to pick up a few otos (otocinclus catfish). They love eating the stuff, are perfectly peaceful, and grow to only a little over 1" long so they add very little to the bioload. One oto per 10 gal or so of tank you have should be enough to keep the diatoms in check, or 2-3 otos per 10 gal would probably eliminate the problem entirely.
Note that otos aren't the hardiest of fish in the world, and often pet store ones aren't in the greatest shape. That means you can often experience more deaths with otos than with a lot of other common fish from a pet store. If you are buying otos, look for ones who are stuck on to the glass or to leaves/driftwood (not sitting on the substrate), and whose tummys have a healthy roundness to them. Otos sitting on the substrate is a bad sign, they are often sick, and an oto with a sunken stomach usually means it is either sick or else nearly starved to death and probably in a weakened state.
Note that virtually all of the other "algae-eating" fish out there avoid eating diatoms entirely. Otos are the only species I have encountered that like eating the stuff.