Every song you play (stream) on Spotify gets counted. So no worries, the queued tracks will get their streams counted too :)
Only local files are not counted because they are, well, local files (not uploaded to Spotify servers and not managed by Spotify or artists).
If you need more help, just ask!
Have a nice day :)