If you scroll to the top of the songs section there's a filter button on the right and you can tap on "available offline" to filter it. Only the songs you have saved to "Your Music" will show up there.
Otherwise there is really no other way to do it other than to create a playlist with all of the songs.
Help others find this answer and click "Accept as Solution".
If you appreciate my answer, maybe give me a Like.