If your refractometer is calibrated then go by that. Yes it is very normal for the swing arm to be off, I have a friend that has 2 of them and he gets different reading both are off compared to my refractometer.
Make use your refractometer is properly calibrated.