Yup, that's probably ich.
Your tank set-up really won't work though. Neon tetras need a minimum of a 10 gal tank and are schoolers that should be kept in groups of 6 or more. In fact, I can't think of any fish I would keep in a 2 gallon tank. It would make a great shrimp tank though.
To treat ich, you raise the heat to 86 degrees and add aquarium salt. Neons tend to be a bit sensitive to this treatment.
Did you cycle this tank before adding the fish? If not, the tank is cycling, which means the fish are likely being exposed to dangerous levels of toxins in the water, such as ammonia and nitrite. This could be what has brought on the ich. If you aren't familiar with cycling, the best place to start is gain an understanding of how the nitrogen cycle works. Read here:
The Aquarium Nitrogen Cycle And here is more info on how to actually cycle your tank, with fish:
I just learned about cycling but I already have fish. What now?! or without fish:
The (almost) Complete Guide and FAQ to Fishless Cycling. I'm not sure if you already have a test kit, but if not it's crucial that you have one to properly run an aquarium, especially a new one.
Whether or not you treat the fish first, I'd strongly recommend you take them back to the store as this tank is
not going to work for them.