Anemones are a great addition in a tank, don't be discouraged. Have patience and see what gives after some time.
I will agree there are some larger anemones I have worried a fish getting too close to and risked losing. I once saw a starfish in my tank fall onto a very large blue carpet, and it would have been dead meat (no pun intended) had I not quickly reacted and grabbed a net and retrieved the starfish. But this incident is not something that commonly happens, in my experience.
I feed my 75g heavily because I have a shoal of Anthias dispar, so I am assurred my anemones eat well. They look very healthy, and I have N.O. lighting for them.
180g fish n' coral reef