For what it is, my speaker is just fine. I will use it for games, but if I want any significant fidelity I listen through earphones or lug into my car/home stereo system.
You need to listen to the speakers of other iPhones before you can ask if your experience differs from the majority. Of all the features of the iPhone, I don't get too hung up on such an insignificant feature like the speakers. I don't like the speakers in my MacPro, but that was not a deal-breaker for me in purchasing a desktop system. You have work-arounds - use them.