I don't think that's algae, it's part of random benthic communities like various hydroids or bryozoan etc that come along with high quality live rock, which that is
I'd just hand remove it, chip em out with a little dig tool at the base and siphon out to see if that works for a given area