What TV are you using buddy? I have the LG B7 OLED and before that Panasonic EX700 which was a crappy LCD and yet never ever experienced what you are describing. Sounds more like the films fault rather than the Apple TV. Do let us know your TV brand.
Are you using the Belkin HDMI cable?
I used that along with Match in the settings and i'll be honest, it's outstanding. It's the only electrical item that doesn't give me stress

I seriously cannot fault it.
What I cannot get my head around though it why computers do not adjust to frame rates in video like the iPad Pro does with Pro Motion? Films look juddery on my MacBook (I noticed judder instantly) and whilst I was in the Apple Store in Covent Garden, they had the new animated Apple advert playing on the iMac, iMac Pro and new Mac Mini with LG Display and guess what... EVERY single one of these computers could not play the video properly - the panning was a complete mess of judders. I seriously could not believe it on a £5000 computer. How does Apple not notice or care about this? Surely a £5000 computer should have Pro Motion as standard? Same with MacBook Pro. It's bizarre as a 1970s TV had no picture judder on panning etc. Sometimes I do feel as though we are taking two steps forward and one step backwards with tech. (hence why I try to live my life with as few tech products as possible - less is more and less is less disappointment!).