What is "the cache" ??
iPhoto has a library, which is on the disk (obviously?!). If you delete a picture from iPhoto, you are deleting it from the disk its on.
If you have your pictures elsewhere as well, and iPhoto is not aware of them, then ?obviously? it wont delete those.
If you go to Preferences > Advanced is "copy photos to library' ticked?