Hi All,
I have been busy with this problem for a while now. Sometimes when I logged in, I saw other devices using my account, casting songs to different phones or devices. No matter how much I searched why it would be, I couldn't find out why. Now I basically found my specific problem and I want to share it with you in case you are going through the same thing.
Short Explanation :  Spotify had a big database leak including user information and passwords. Hackers/exploiters logged in to my account and updated my plan to "premium for family" and then invited random people to use my plan. That's why new devices popped up suddenly.
Long explanation : Even if your account is created with Facebook login, spotify has a passwrod attached to your account for using at devices. If you never activated this password, it still is there at spotify servers as a random password. A few weeks ago, there was a big leak of user information from spotify which included these passwords. No matter if you login with facebook or not, it is leaked as the password exists. This way exploiters are able to log in from their devices and chane your plan or use your account as they want. 
Solution : For those of you that are using Facebook login, changing your facebook password will not work. What you have to do is in order :
1) Login to spotify web, go to account settings page and click "Set device password"
2) Follow instructions and set a new password (Yes, even if you use FB login)
3) After PW is set, fo to Account Overview and click "Sign out from everywhere"
4) After this check your plan, if somehow it is upgraded to "Family" downgrade it
5) If you are at Family plan, click "Premium for family" and check invited devices. Remove the ones that don't belong to you.
After this you will not have the random devices popping up problem anymore.
Cheers