If the chance of a fis getting stuck can cause worry, or a death, then yes, I would remove it.
A friend gave me some fish and a little log decoration. Which had been in a shrimp tank. It seemed a reasonable size for my Cories and Kuhlis and baby Bristlenose Plecos, but a Cory got stuck because it panicked. But I removed it to be safe.
With addltional Guppy fry you may want to do an additional water change - add one. Guppy babbies need safe water to grow properly. Aquarium water will get to unsafe ammonia levels much more quickly. Unsafe water ammonia, nitrite and nitrate can cause damage and or death. Also can spur aggression and flashing/ scratching on things too.
So after a male is in the tank with receptive females. They can, store the sperm for 6 months (some say 8)
and continue having babies.