Yeah, Safari is a buggy mess right now. There is a new fix in development--I don't know if it is coming with 10.4.3 or later (I believe later)--with hundreds of memory leak fixes, etc.
Unfortunately, Tiger and many of its components are a mess. Microsoft quality. Apple is close to fixing many of them--not that this forgives anything.