If only Apple sold a traditional controller and didn't depend on third party companies to provide controllers, which often have incomplete support/compatibility. A gaming controller from the source blessed with full support would be a godsend.
Apple didn't really commit to gaming and that's the problem. The remote is a terrible game controller. Apple should have created a first party controller and allowed at least 4 controllers to be connected simultaneously. There is absolutely nothing attractive about Apple TV as a gaming platform and I think they've really blown their chance to be taken seriously in that market.
As for streaming media, I actually prefer the interface for Hulu and Netflix on Apple TV3. I often have to swipe up and relaunch the Hulu app in order to see updated content. I find this very annoying. ATV3 apps had clean, efficient UIs. ATV4 apps are the opposite. I have yet to find a really cool app that makes me really see the product's potential. Not Apple's fault, of course, but maybe apps aren't the future of TV after all. I had high hopes for an Apple TV with App Store but am quite underwhelmed by ATV4.