Important to note that there isn't a straight forward queue string in the Community on how to remove things from the queue.
The problem is that when playing one of your playlists the 2nd song isn't in that playlist, Its a totally random song. If its driving you crazy - trying to figure it out - the solution is that you need to click the queue button. A pic is here:
(Then after this is how to actually "clear" the queue)

