Hey @itsmattm, welcome to the Community.
Hope you're doing great!
To remove single songs from being available offline just tap the … at the right end of that song and find View Album. Once you're there if the Download option is not toggled, toggle it so Spotify will recognize the song is downloaded and just remove it again.
Hope it helps 🙂
LoxerSpotify Star
Help others find this answer and click "Accept as Solution".
If you appreciate my answer, maybe give me a Like.
Note: I'm not a Spotify employee.
