I am running into an interesting and perplexing issue with the new Music App. I do not use Apple Music and have it turned off. Under the "My Music" tab when you click the red pull down to select Artists, Albums, etc, I have the show iTunes purchases set to off. The problem is, they're still showing..(sometimes). I haven't changed any settings, all of a sudden, there they are. If I close out the app on the app switcher and reopen it, they're gone. Then they'll reappear. I don't get it. I know these tracks shouldn't be there because they do not have the little iphone symbol in the list and some of them I don't even have in my itunes anymore. This is crazy.
If you're seeing iTunes purchases show up and without the little iPhone icon on them. Turn ON the option. (Off aka. Toggle not green means you will see stuff you've purchased or in the cloud not on your phone. Green toggle means only stuff on your phone will be seen.)