Sorry to help in revival of an old thread, but this does fix the issue:
I've seen then issue when helping friends. I don't know that it's necessarily related to Vuze, because none of my friends use it, but we also could never figure out the origins of it. What I do know, is even if there is no toolbar folder, CT Loader buries itself inside of the following folders:
/Library/Application Support/Conduit
/Library/InputManagers/CTLoader
/Library/Receipts/ctloader.pkg
/Library/Receipts/<Toolbar name>.pkg
/Library/Application Support/SIMBL/Plugins/CT2285220.bundle
/Users/<User name>/Library/Application Support/Conduit
Just follow the paths. Remove: Conduit / CTLoader / ctloader.pkg / <Toolbar name>.pkg / CT2285220.bundle / Conduit.
~ (Tilde) character represents your Home Folder.
Move all the files to the Trash. Relaunch Safari.
Credit to Carolyn in this thread at apple discussions for helping me, you, and many others.
http://discussions.apple.com/thread.jspa?messageID=11333136&