After the first 15-20 minutes, you want to pour some of your tank water into the bag and let sit for another 15-20 minutes. Sometimes, another pour into the bag is suggested also. I tend to acclimate them for 50-60 minutes before transferring them into my tank.
I think they're just stressed from the sudden change in water (since they went from their water straight to yours).