The pH swings could also be contributing to the stress in your fish. What I believe is happening with your pH is the water is off gassing and the pH is changing. Some people let their water sit in buckets for a day and then add it to the tank. Or the other scenario is that your gravel or something is changing your pH. Let a cup of water sit out over night and then test the pH to see if it is closer to your tanks pH.