I have a cat and cat hair will immediately stick to the silicone case and it's basically impossible to get it off short of some kind of brush or wet napkin or similar thing. What's worse is that you can feel it on there to a surprisingly extreme degree. I guess because the silicon is so perfectly smooth the piece of hair just really presses out into your skin, so even just one hair on there, you move your hand around and you feel it and it's obnoxious.
So yeah, frankly, it's a real problem. It would be a nice cover if not for this. I think what happens is the material is naturally, easily static-electrically charged so it attracts a lot more crap than you'd expect.
Personally, I'd just love it if Apple or someone else would make a leather back cover on par with what Apple produces for the iPhones. At this point, my recommendations for back covers are one of the cheap crap chinese hard clear covers or maybe one of the screen covers that include a back piece just to protect that super shiny apple log. But, with the new iPad Pro 9.7" the protruding camera suddenly becomes a minor concern. The glass will be fine unless you put it on diamond sandpaper or something, but, the chamfered edge my get mucked up.