The good thing is gravel is easy to change out. Just do it a little at a time so you don't hurt your bacteria colonies..a few handfuls of old gravel out and an equal amount of new gravel in at each water change...it takes a while but eventually you'll have the gravel changed out if that is what you want to do.
I know I do the same thing even now. I think I want a colored gravel and always end up changing out to natural
I've probably used every color gravel under the proverbial rainbow (except the flourescent looking ones).
YOu did a good job