Unfollowed someone but i still appear on their followers

[alanamichael]

I was looking at my ex's profile and followed him to see what he's listening to and i unfollowed him but i became one of his followers and still appear on this followers. how do i remove this asap before he sees