I've noticed that, too. It's not just Safari, I've tried it on Safari, Firefox, Camino. It's slower on all of them.
Give Firefox or Camino a try - they are faster than Safari, especially noticable if you're on a dial-up connection. See other threads for commentary.