Lowering phone volume from computer?

[audreyruckman]

Concept: Me, cozy in my blanket cocoon, using my computer to browse Spotify. I'm playing music through my phone that's hooked up to speakers across the room. When I try to lower the volume on my phone from my computer, nothing happens. 

It works perfectly well using the phone to change computer volume, but not vice versa.