Playlist/Recommended Songs question -Premium account

[Ydaani]

When I get to the end of a playlist the recommended songs start playing. That’s fine and I enjoy that at times. But I noticed you can’t skip back to the previous song on your playlist once Spotify starts playing songs from their recommended playlist. The previous track button on my phones lock screen is replaced with the like/dislike feature and using the button on my headphones will only take you back to the first song on the “recommended playlist”. 

Anyone have a solution for me or is it just how it is?  I need to be hands free at work and use my headphones a lot to control my phone so I don’t have to take my phone out of my pocket. Minor issue in the grand scheme of things but would be a nice quality of life addition.