The CAPS button is useful to flamers and ragers who want to SHOW HOW MAD THEY ARE. RAWR
But yeah, I really wish they would take it off. I hit it by mistake.
How would you hit it by mistake more or less than any other key?
In any case, the caps lock key is extremely useful in some situations. For instance, I routinely have to fill out some forms where some fields are required to be in all caps. I would be very upset if they took away my caps lock key!