Overall Mavericks is a great upgrade. Just make sure to reset SMC and NVRAM/PRAM after doing the upgrade over ML.
I have a 2012 15" rMBP 2.6GHz. With Mavericks now 1GB of VRAM is used (512MB in ML).
Much more responsive than 10.8.5, laptop stays much cooler, does not get hot during video playback, overall UI lag is way reduced, not 100% gone but it is a huge difference. Mission control can stay ok with loads that made ML crawl.
Scrolling is also buttery smooth in Preview, and almost all 1st party apps apart from Xcode and iTunes. Safari 7.0 is also way faster, most websites approach 50-60fps, but there still some that are slower, BUT, it makes Chrome 30 and Safari 6.0.5 feel DOG SLOW.
In general a great upgrade for me. Wish this was out in 2012 when rMBPs were first introduced...