Is there any chance you're using the AdBlock extension?
I've noticed that AdBlock causes a gradual memory leak in all versions of Safari since the addition of extensions, which drove me to try GlimmerBlocker, an alternative (although not quite as thorough as AdBlock).
I'm using Safari 6.0 Developer Preview 2, by the way.