Have you been to Pacific Aquarium and Plant? It's located on Delancey and Eldridge streets. It can be a little pricey but they have a huge selection of plants. They also sell shrimp (all kinds, I saw a chocolate shrimp once, bumblebees, etc.).
Fauna is another store on the upper west side on...