IMO, you should definitely be gluing them. It makes it easier to form your caves and you have significantly less chance of a cave-in. I used to try to build caves without glue and I could never really get it to work the way I wanted.
As far as the type of glue is concerned, I would stick with...