Yep that happened to my 4s, hence I will never use Otterbox again. It also left marks all over the aluminum frame.
Cases that use TPU or silicone to wrap the phone first, with a hard cover on the outside are better. Otterbox makes those too, but they are too huge IMO.