I hear you, iTunes 11 is piggishly slow for me on my RMBP.
It's not that bad in windowed mode, but in full-screen it's awful.
It's not to do with the scrolling speed - it's to do with the software not being able to keep up with the scrolling speed you have. Increasing the scroll speed (if you could) would only make it worse.