While playing Spotify on my TV, which is Roku enabled, dark mode only blackens the background. There's still a bright white song and artist on the screen, making the dark mode feature almost irrelevant because it's still shines brightly in a dark room.
Your app also blocks the ability to black out the TV with the remote. For example, Tidal allows you, on a Roku TV, to select dark mode, which blackens the screen completely. If I'm paying a premium membership on Spotify, I should be able to do this, it's just good customer service.
then turn down the brightness of the TV down before you open spotify