Solved! Go to Solution.
Strange. If I'm listening to an album started by tapping a track in it and start another album, also by tapping a track, the queue is cleared and replaced by the tracks in the new album. The only way I can reproduce what you're describing is to long touch a track and select "add to up next".