That's weird.
I remember having a whine when I got it, and that was Mac OS X 10.4.4.
I know I updated to 10.4.5 at one point, and I don't remember the whine going away.
But then again, I rarely hear the whine (as I use a Bluetooth mouse 99% of the time).