Yes, when the levels are at 0. The main reason I would leave the shrimp in until nitrite went to 0 is to get as much bacteria growth as possible. Once you remove the shrimp, that's the max bio-load your tank will have as it will not have anymore ammonia added to the system. You want the max. until you add your animals and let the tank adjust from that point on.