I was trying to remove a library track from my iPhone, and then iPad, but neither worked.
Thanks for getting in touch!
You can remove a song from your library by tapping the green heart from the Now Playing view.
Hope it works! Let us know how it goes.
Have a nice day.