This will sound stupid, but make sure you aren't covering up the speaker at the bottom of the phone. The speaker is on the right and the mic is on the left.
Also, make sure you don't have a case that is covering it.
If you adjust the volume at the home screen with no music playing it will adjust the "ringer" volume, which also affects these sounds. Make sure it isn't set low.