Nope, as long as you don't mess with your filter you should be just fine. IMO
you might even help
Your cycle. The colored gravels have always been sketchy to me. most of those gravels are really white gravel the has been color coated which can't be good for a system.
Couple tips. I would remove about 25
To 50% of your tank water. And then start scooping out the gravel. Once you have that done. Whichever sand you choose, remember to rinse the heck out of it. A lot of people use play sand from the hardware store because its really inexpensive. Only downside is you have to
Do a ton of rinsing. The easiest way to rinse is to fill a 5g bucket 3/4 full of sand and turn on the garden hose. Keep shoveling the end down in the sand while letting the bucket over flow. It's done when the water in the bucket runs clear!