Yep...I had one a couple years ago. Loved the case, but didn't like the "eraser" rubber. I tried a new one with my iPhone 5, but it did the same thing and I took it back.
I think it has to do with the color of the rubber. The gray rubber seems to flake badly, but the solid black rubber doesn't flake at all on any of my candyshell or candyshell grip cases.