It shouldn't no. As long as you don't remove any of the media in the actual filter, but just moving it should be fine. Test levels for a day or two afterwards anyway; sometimes disturbing things can kick up hidden waste and uneaten food which can cause a temporary spike in parameters but I'd say go for it.