Uuh, pardon me if I'm wrong, but I think that there definetly WOULD be a substantial amount of bacteria in the gravel. If you do not have a lot of bio-media in the HOBs, I would advise against switching it all at once.
If you have plants or a colonoy of MTS or any snails, then I would remove...