The latter, sort of. You really aren't supposed to care if apps are actually closed or running in the background. The multitasking switcher will list apps you've recently used, whether they are currently running or not.
Just let the OS decide how to manage running/closing apps, and you should be fine.