It's on the black iPhone 4 as well, you just can't see it as easily cause it's a black hole on a black phone. On your 3GS you can see it as three little circles next to the speaker.
Look at the front of your phone in direct sunlight, you'll see the three little circles next to the speaker.