Hey @micha89! Welcome to the Spotify Community. ^^
Hmm, that doesn't sound quite right.
Try to do this:
1. Go to your profile page
2. Scroll down
3. Click on 'Sign Out Everywhere'

4. Change your password again through the password reset page
Let me know if that helps, thanks! ^^
Peace