I know what you mean, my boyfriend says the same thing, but being a woman, you can scratch it easier simply by using earrings, and throwing it in a purse, etc.
If I didn't wear earrings, I'd probably not put a tempered glass protector on. But I do. My 5S had a glass protector, and it worked well. My 4S did not, and it did have a scratch on it and I'm assuming it was from earrings.