That is an issue for me too. Probably just a pet peeve but still it's source of discomfort especially when I am not using earphones. This has actually been a dealbreaker for me to get iPad Air 2 (which was a really great upgrade from any its previous gen).
I never use headphones with my iPad so it was a huge deal killer for me. I was soooooo ready to buy one when they came out but one trip to my local store immediately revealed this problem and the air came hissing out of my balloon. Damnit. That's why I was hoping the Air 3 might rectify this. Oh well. Maybe the Pro will work for me?