Shale is fine - it's just like slate, only softer. It may cloud up the tank a bit if it's not rinsed thoroughly, but the cloudiness will soon settle on its own. If the edges are jagged, it may injure clumsy fish like bettas; otherwise, it's a nice cave building material.
Never heard of goldspar, and a search turned up nothing. I wonder if it's in the feldspar family? I've seen feldspar for sale in my lfs, so I assume it's safe for aquariums. I've never used it though.
Granite is fine so long as it doesn't have any reddish/orange iron veins in it.