In the desktop PC version go to Browse > New Releases
It displays a grid of new albums, EPs, etc
If you hover over an album cover there's a play button in the middle. I click on it and it doesnt play.
I have to click on the album title and then play it from there.
I can play from the Browse -> New Release page fine. Have you tried re-installing your Spotify client?
It's the latest client.
I should add I'm playing music from my iPhone (green bar at the bottom "You are playing from: iPhone") and controlling it from PC.
Could I ask if you are still experiencing this issue on the latest version of Spotify?