You can definitely turn the water off after the siphoning has started, but as TomK2 stated, if the sink isn't much lower than your tank, the suction is poor and you can't do a great gravel clean. When I'm siphoning the water out into my lawn, I can turn the water off and still do a good gravel...