Think you were right at first thought.It does look like a piece of your rock,notice white area in the above rock,probably fell from there.The turning in color is the Coraline algae covering the piece and it looks like it has some caulerpa algae sprigs growing from it.