The iPhone 4S's proximity sensor is on whenever the phone is on. As soon as the phone is unlocked, the sensor is active so it knows where it's at in perspective to your face. This is solely for the purpose of raise to speak with Siri.
The iPhone 4 and previous models have a proximity sensor that ONLY turns on during a phone call so it can black out the screen to prevent face-dialing.