Wow it's amazing how the parents are able to keep all the other fish at bay. I once had convict fry, I don't remember if I left them in the tank with the other fish or removed them. I didn't have as many fish as you do though, otherwise I would be sure that I probably removed them.
All I remember is that about 5 members ended up with grown convicts.
Good luck with them.