Lots of people do this. You can use aquarium sealant to glue rocks or gravel to the PVC
to make it look better, or paint it with Krylon Fusion spray paint. Or both. Just be sure that both methods are allowed to cure or dry thoroughly before putting them in. I wait at least a week.