Ruh roh. You need to get a selenoid on there. You don't want to have the c02 running full time. It needs to turn off and on, either with a timer or a pH meter. If you leave it on 24/7, you are going to have way too much... especially at night. Plants don't use CO2 at night so adding it to the tank, it will just build up.
You could also just go ahead and turn it off manually when the lights go out, and turn it back on in the morning when you get up, but this is not ideal.
Replacement CO2 Solenoid For CO2 Regulator
Checkout the link. Pretty much any co2 solenoid will work, but this will give you an idea. The cord coming out then plugs into a timer or the ph meter, and when power is shut off to the solenoid, it turns the gas off.
The reason I recommend the pH meter is because wild CO2 swings can encourage a lot of algae growth... unstable CO2 is especially encouraging to the dreaded BBA (black brush algae) which is very difficult to get rid of and very unsightly.
I recommend this meter:
http://www.eseasongear.com/mism.html