Help: Returning to front pages of apps

Apologies if the title is misleading but I couldn't think of a better way to word it. I've tried searching for this "issue" but I haven't had any luck yet.

Whenever I open an app, YouTube, Photos, [any game], Gmail, ext, it always goes to the last page I was at. For example, if I open "Phone" it goes to the contact I last called, or if I open YouTube it'll go to the video I was last watching.

Now while this is occasionally convenient, the overwhelming majority of the time its annoying. It seems like every time I open an app I end up having to press the back button several times to get started. I didn't have this problem when I was using my iPod Touch.

Is there a setting to change this?