Go to settings > general > multitasking > slide off allow multiple apps.
But be aware this will make it so you can no longer do split screen multitasking.
If it is just that. It is always outlook. Swipe from right edge to left > then swipe down from that new world now to close that app and close a new one.