Restarting the device works. But this is not a permanent solution. This happens to me about once a week, and it's quite annoying to have to restart my PC every time this happens. I believe it's a bug where Spotify checks with Windows to see if there is an internet connection without actually trying to connect.
Spotiamp works and can see that I have an internet connection - why can't Spotify?