Yeah, sometimes the males will do that. I had one male who never got over it, so I'd had to take him out of the tank also. It's not preferable, but the fry can survive without dad there to take care of them. Luckily, he at least would place them in the nest, but he'd slowly eat them all once...