I don't see much of the lag that you and a few others keep complaining about.
Here's a video of my late-2013 rMBP 13" (2.8GHz i7, 16GB RAM, 512GB SSD): https://www.dropbox.com/s/2yq9f5z2uq1t7jy/IMG_6220.MOV?dl=0
Run it at 1680x1050 (HiDPi). You'll notice some, not major, lag.
Furthermore, just having a lot of VRAM doesn't mean the performance would be better. You still need a powerful and effective GPU to process that information. It's like having a large room with boxes and boxes to be shipped but you only have one person processing the boxes.