Something growing on my coral

[JAS1234]

I have this gritty slime tube growing on my lps coral. It comes from the rock and has killed a torch coral. If I see it in time and I move the coral to another location the coral gets better and will recover. I attached some pictures. Any help is appreciated.

 

[Sniperhank]

It is some type of tube worm that makes a slime tube that hardens up with sand/rock.

 

[JAS1234]

How do I get rid of it?

 

[JAS1234]

I just don't know why it always grows onto the coral and how to stop it.