Sounds will play over your headphones if they are plugged in and the mute switch is turned on (you can see orange).
If you are using apple headphones with the mic this is actually a good way to have a phone call without picking up the phone.
You can just press the answer button and you will hear them through the headphones and talk into the mic on the headphones.