Hi there,
Welcome at the Spotify Community!
I have an Galaxy S4 and an Samsung Smart TV too, but it doesn't work for me either. I think because the Spotify app on TV isn't updated with Connect.
I even don't know if Connect is available for TVs at all.
Unfortunately Samsung Smart TV's aren't yet supported for Connect.