It's your most recently used apps. Handy shortcut to switch back & forth.
Presence there doesn't say anything about running or not, some are possibly running (e.g. Music apps can play in background, GPS apps can navigate in background) and some aren't.