This is really the only issue I've had as well. Sometimes it happens. Maybe once a week or so.
What sucks is when I forget that I've turned it off...after using Spotify for an hour. Last month I got stuck with an overage fee from AT&T. I should send the bill to Apple.