Spotify never stops playing

[Elfishi]

I would like to have spotify stop playing music after my the album I selected is over. 

Instead it starts with the same playlist again, only repeats the last song, continues with an album I had as a playlist last week or fills the playlist with random albums by the same artist. I do not want this behaviour.

I am using the Windows app, but the same happens with the android and iOS apps. Don' get me started on the web player, it doesn't even show the playlist.

The two little arrows above the progress bar are set to grey and the auto play switch in settings is off.

Is there a way I can make spotify stop like described?