I can't reply to that topic, so I'm opening a new one.
Please do some research on that topic. It's really annoying that I can't browse albums via Android Auto. This is a basic feature that simply MUST work.
Just as the writer of the topic I pasted above, I highly suspect that the problem exists because of the count of albums in the library. When I had less albums, browsing worked, and it stopped working, when I added more and more albums.