The cories will be fine has your goldfish acted aggressively to them at all or chased them? If he hasn't your cories are fine I suggest getting them some type of small cave though for structure if you don't have one.
No, he has never been aggressive toward them. He was kept with a small emerald green Cory since I got him. The cories have some plants to hide behind too.