You just described the problem perfectly. Different people get different mileage out of the ports in their laptop. Some ports get used more, some are used less, and some ports don't even get used at all. There isn't this one array of ports which will make everyone happy.
You find the HDMI port indispensable. On the flip side might be a user who has never plugged in his laptop into an external display and will never find a reason to. This port becomes dead weight for him, and it's not I can reprovision it as another port of my choice.
Just as the ports you admittedly don't care about might be ports other people find indispensable.
In this context, why not replace the HDMI port with an extra USB C port? With an adaptor, it becomes the equivalent of a HDMI port for people who need it, and it's still an extra port for people who don't, to use as they deem fit.