I cant believe I'm answering my own thread.
I ventured to Pacific Aquarium on the lower east side during my brief visit to NYC.
Pacific Aquarium Inc
Dont let the Chinatown/Bowery location or the outside of the store deter you. This place was amazing! Yes, it's cramped, but they have over 50 tanks of salt and freshwater plants and animals. They also have all the hardware, supplements, food that you would need.
The tanks were clean. Staff was knowledgeable.
They had quite a few fish that I had only read about in these forums and haven't seen elsewhere. For the more common fish there is probably a 1-2 dollar NYC mark up.
The plants were great too
i will definitely go back, esp, if i get bigger tanks.
I also hope that one of the nerite snails I got starts moving soon otherwise I may have to amend this review.