Yes that option is available on the mobile apps :)
Simply go to Your Library and tap Playlists where all your playlists are located. Once there swipe down to reveal a search filter and a hamburger menu next to it(three parallel lines). Tap on the hamburger menu and it will reveal different filters including Alphabetic.
Let me know how it goes.