Yeah, the jack was really an issue for some.
Personally, I was glad to see it go. I rarely use my phone for music as I have other devices and means and preferences for that. However, I understand why it bothered a lot of people.
That said, Apple has always done as it felt it needed or wanted to do. It's rare when they do what the customer wants. Apple is more into telling the customer what they want instead of hearing the customer.
In any case, you're correct in that decisions like this have been part of the makeup that's driven some of the polarization around here.