Unless you have pristine tap water, you need some kind of filter. Good tap water may only need a DI, the Tap Water Purifier mentioned before is a DI filter. For not so good tap water, a RO filter , or maybe a RO/DI filter will be needed.
Unfortunately, someone mentioned that "pure" water...