Looks like sponge growth. I'd guess you could toothbrush it off, but most likely it'll keep growing back.
As for the dark red, is it slimey or hairy? You can manually remove as you stated, but make sure you siphon out if it is an algae.
It's neither slimy or hairy. Red coraline? I toothbrushed the white stuff and it came off well. I'm taking it to my LFS today to see what they have. Check this out on my brain coral. Idea? It closes up when I touch it..
Not coralline. That is a macro algae though. Coraline doesn't normally branch up. The name of it is currently escaping me, but here is an Id link I keep on my phone. http://melevsreef.com/critter-id