I have all kind of issues with my Chromecast. I have done a "factory reset" few weeks ago and only partly solved them. It doesn't like much my Plex server (on macOS), getting stuck when subtitles (SRT!!) are on, I have to close and reopen the apps to have the Chromecast icon showing in my Xperia X Compact (with Android 7.1.1 and monthly security updates), the apps loose the connections to the device, with the videos keeping playing by themselves and no control. And it seems to get worse with time instead of improving.
Which is in line with how Android TV works in my Bravia. Bugs everywhere. Sure the Shield has much better hardware and support, but I am tempted myself on buying an ATV 4K, use the TV as a display, and forget about that awful (and slow) Android TV. Although I would still use the Android part for YouTube 4K (no HDR, yet. Although the HW is ready) and TIMvision here in Italy. Kodi is cool but is too heavy and I just use it as a media player, being the only one working (on Bravia) with all video and audio formats. Plex keeps transcoding for no reasons. But I read the ATV has Infuse and that should solve my LAN streaming problems.[/QUOT
Being honest, that's what i've always done and thought about TV ever since I bought ATV in 2010. I've always though as the TV as a monitor screen with speakers. Surely if you're going to use computer technology with it, you buy a separate box from the computer company that makes the absolute finest hardware and software in the world and IMO, always have done - Apple

It's stress free! You don't waste your precious time. I read a B&O site where pretentious fools spend £2000 on a cheap £90 Android tablet 'thing' and guess what, three years on, it still doesn't work properly and that's purely a simple music streamer at £2000 (the price of a maxed out MacBook Pro TB 13")!!!
An example is our Thursday night film night. 7 to 10+ friends come for a late dinner and then at midnight after chatting and laughs, we watch a film and enjoy the experience. The Apple TV performs flawlessly with it's beautiful user interface, mind blowing screen savers which come on as I make espresso and cake for everyone and its sheer performance with no freezing, buffering or problems. Why would I ever want to move from that???