If you open up the file you downloaded for Safari 4, this will have a uninstaller and will put version 3 back on
If you dont have the downloaded file you should be able to download again and then when it runs select the uninstall option
Hopefully this should fix your Safari issues