Because of this I have to kill the spotify process and restart every time I connect my headphones.
I have had this problem for a long time, and several different machines.
Mac seems to have the same problem:
https://community.spotify.com/t5/Desktop-Mac/spotify-can-t-handle-changing-audio-devices/m-p/1241583...