It depends what the bottle is telling you to do. I never recommend turning a skimmer off unless something is added to the system, like red slime remover, to where it is instructed to turn off the skimmer.
It's been a couple days and the fish are looking better, no deaths. I stopped putting the ich attack in and turned the skimmer back on as it told me to take out carbon on filter and turn off skimmer.