It's a problem of the Nexus 4 and iPhone 5 has it too. It's because the screen technology is different from phones like mine, the S3. The screen has less layers I think. Before there was a layer for touch input only and now that layer is unified with the layer of the screen, which in turns produces that second lag.
Look it in Nexus 4 and iPhone 5 reviews on websites and YouTube videos. It's a hardware problem.