I’d start with making sure that you are maintaining your fish and aquarium properly.
First of all, don’t overfeed your fish; it’s common for aquarists to feed their fish too much which leads to health problems. Keep in mind that a fish’s stomach is only as big as it’s eye, so a tiny pinch of food is all your 4 fish will need daily. Also, varying your fish’s diet with 3 or 4 alternating foods will boost their immune systems.
Parameters: You may want to invest in a water test kit (I recommend vials over strips) to test the chemicals in your water. If too much ammonia, nitrate, or nitrite develops in your aquarium, your fish can contract diseases. Also, an extremely high or low pH can also stress fish.
Water Changes: It sounds like water changes are behind the stress of your fish. If this is your first major water change, you could have accidentally shocked the fish. If you remove too much water (I recommend no more than 75%), your fish may be stressed from such a quick change in parameters. Also, when you change the water, thoroughly clean the gravel to remove nitrates and fish waste that has built up in your substrate. Be sure that when you add water back to the tank, it is similar to the water in your tank. This means that the temperature and pH are ideal the same. Most importantly, don’t forget to add something to remove the chlorine in the water, otherwise your fish will likely die.
I also recommend buying bacteria on a bottle which can be found at most pet stores and will boost the immune systems of your fish.
Good Luck!