What happens when you click on an album. The album should open up with all the songs in the album. Then you click the first song in the album and make sure you don't have shuffle on.
Have a great day.
If this is a solution please mark it as such.