I had this problem when I was jailbroken, and try to set my phone up as a new phone but copied all the image files back into my image roll directory. Turns out they had the wrong file permissions on them, and couldn't be deleted by the app.
But if you are on an iPhone 4 then you aren't jailbroken.