If they are IN your zoas then most likely yes. I'd do a coral duo on your zoas and manually remove as many as possible. You'll probably still have eggs left though. Those will devour your zoas.
Are the color of the zoas green? Then I would say, yep! Always dip zoas. They come full of critters.
I use Coral RX. Make sure you read the instructions well. You don't want that stuff in your DT. I usually dip my corals and luckily the one or two I haven't dipped had good critters. I killed a tiger pistol once in a coral dip (wasn't mine, he hitchhiked) and I wish I'd seen him sooner to put him in 10 gallon. But it's a good thing to do.
You will have to dip a few times to get rid of the eggs and newly hatched.