If Apple wants to reinvent the TV, they just need to make the Apple TV box the hub into which your TV periphs are plugged.
I have that - here's the backside:

Only 8 HDMI ports and only 9 digital audio inputs, though - I'm beginning to consider a higher model.