The sad part is that even if I just push the power button (not to Swipe to shutdown, just put it in to "sleep" mode), Apps lag when I get back to them.
I highly recommend just sticking to 5.x for anyone, it's not worth it. It might be okay if you only use a few apps, but if your iPod Touch is like mine, you've got a lot of content - games, apps, etc and things just seem to lag.