Yes it's in there. In the full screen player tap the three dots in the bottom right corner. (See first image)
On the pop up menu tap either the album art or the ">" arrow. (See second image) *note the image is from iOS 9, but iOS 8.4 you tap the small album art in the same menu at the top after tapping the three dots.*
Third image is in the album view with the back button (top left) that will take you back to where you were. (In the case of my images, it's my Punk playlist.)