Whenever I make a new playlist from the web player (play.spotify.com), the playlist is always public.
As I understand it, new playlists on all other platforms respect what I set in settings (I choose playlists secret by default) so it seems like the web player doesn't take this setting into account.
Updated on 2018-02-24