Do you have any extensions installed in Safari? Ad blockers etc? If so try either updating them manually or removing/disabling them.
Is the behaviour your observing happening randomly, or can you narrow it down to certain sites? Here I'm thinking about looking for technologies such as flash or java, resource intensive technologies, that could be used on certain sites and effect the browser performance, or maybe just very badly coded and optimised sites.