It's a hardware problem. I have the same issue. I've tried another iphone 5 and it exhibits NONE of these problems.
I seem to notice it more on apps that haven't been redesigned for the iPhone 5. I've also noticed that the scrolling speed can sometimes be erratic & scroll really fast as if there's a sensitivity issue..