Actually, this is talked about all the time by gamers. You've never seen discussions about latency issues causing people to lose at a game? Either because gamer A has a faster internet connection or a faster graphics card, the higher framerates allowing for better response time, both of the human and the software.
You're not wrong. Response time on touch screen does produce similar results to internet lag in games. All your actions are being accounted for, but they're always just a slight bit behind the actual input. If your latency is too high, it starts feeling floaty and way, way off.
I'm not arguing that there isn't a difference, just that the difference is suddenly being blow far out of proportion now that a whole bunch of people have a solid number to put to it.
Just to test things out, I fired up Procreate and Art Studio on my iPad 3, and started dragging my finger around the screen to see how well the brushes tracked my finger. Long story short, it lagged behind a good bit. I'd say roughly about the same as the 100ms example in that video I posted. I'm willing to bet that the iPad 3 has an 85ms response time, same as the iPhone 4S.
The question is, have I ever noticed it before? Yeah, I have on rare occasion. Has it ever bothered me before? Not in the least. A stroke lagging about 1/10th of a second behind my finger doesn't present any problems with what I'm using my tablet for. I'm almost definite everyone posting in this thread has noticed it, but never gave it much attention, either. It didn't effect their user experience.
It's different with games because you're interacting with a hectic environment that requires pinpoint accuracy against moving targets. You're gonna notice being even 1/30th of a second off. With a tablet, more often than not, you're just scrolling stuff around. It's a much more laid back affair. You're interacting with it at a pace that looks like it's doing what you're telling it to do right when you tell it to do it.
So yeah, lower latency is better. I'm not gonna deny that. What I am arguing against is that the difference between the 55ms on the iPhone 5 and the 115ms on the GS4 is that big of a deal. It's not something anyone would notice through casual use.