My saved tracks started downloading for some reason. I only have 2 albums set for offline avaibility yet the rest started to download on their own. I can't seem to 'undownload' them. Toggling offline off or on doesn't help. I'm sure they are already on my devices as the tracks are playable on offline mode.
Device is a Xperia Z3, Spotify data is stored in the SD card.
Here's a screenshot. Offline is clearly toggled.