We need a lot more information before we can help you. Has this always been the way, or did it just start happening? What were you doing when it started? Have you tried to organize your photos in the library in finder rather than in the iPhoto app itself? What version of iPhoto are you running? How do you import your photos inti iPhoto? Via the camera, from a folder, drag and drop?
Help us to help you by providing more info.