RO water is commonly drunk. The Glacier machines use
RO, and I believe Dansai is just tap water run through
RO with some additives.
DI water is perfectly OK to drink, but it probably won't taste very good. Water's taste comes from the minerals dissolved and in suspension.
DI or distilled water lacks those minerals and tends to be pretty unpalatable.