Spotify Connect disconnects constantly

[Jkellyinsf]

I'm running Spotify on Windows and listening through my Android phone via Spotify Connect.  They'll stay connected for hours if I don't mess with anything and just let stuff play. 

But if I answer the phone or switch to a different playlist on the Windows side *and* the phone had gone into sleep mode (>1 minute), it loses the connection every time.  I have to wake the phone back up, bring up the Spotify app, press the green button that I want to continue listening.  Then go back to Windows, reopen the device menu, and reconnect to the phone.

The charm of this is wearing thin.  How do I get it to stay connected?