Yes, they will replace them. But try cleaning out the headphone jack first. (Use a paper clip and GENTLY poke it in there to see if anything sticks to it.)
I went to the Apple store for broken headphones and they discovered pocket lint in the jack. They fished it out and everything worked fine.