Ferns really don't consume a lot of nitrates, I would guess overfeeding /not enough water changes, how often do you rinse the filter pads in tank water, how thorough do you vac the gravel, how much food do you feed, how many fish and what kind ?
I would up the water changes to get them to a lower ppm as water changes are the only way to remove nitrates, or add a bunch of nitrate consuming plants to the tank, check filters for built up waste in the pads, you could also get a common house plant and let it grow immersed with just the roots in the tank (pothos plant)
As far as losing fish, nitrates at an extreme high level >60-80 will weaken the fishes immune system so they get sick easier, can't fight off illnesses, you may have what I did was called old tank syndrome, i had big pebble gravel and no matter what I did I couldn't get my nitrates lower than 60 with my tap being sub 10% ppm, I changed gravel and my nitrates now are 20-35 and I dose 14 ppm no3 weekly.