before ios7 you could hold down the caps key and it'd lock with a blue color change on the icon, I have noticed this is gone in ios7
I have caps lock off but to my understanding that's only to start a sentence however I had turned off on my 4s with ios6

I have caps lock off but to my understanding that's only to start a sentence however I had turned off on my 4s with ios6