Yeah count me in the "I hate the Siri remote" group. I played with it for a couple hours when I first used my ATV4, to give myself an general feel about it. The Siri microphone can be kind of nice, but hardly a must have feature for me.
My fix: It's been in the drawer ever since. I only control my ATV4 using either my Harmony or my Nimbus. Which also gives me the grid alphabet input layout (a lesser evil than the horizontal one IMHO). So the Siri remote problem was easy to avoid for me, but I understand why people without MFi or universal remotes, disliking but forced to use it, may be having a negative experience with the ATV4 as a whole.
My fix: It's been in the drawer ever since. I only control my ATV4 using either my Harmony or my Nimbus. Which also gives me the grid alphabet input layout (a lesser evil than the horizontal one IMHO). So the Siri remote problem was easy to avoid for me, but I understand why people without MFi or universal remotes, disliking but forced to use it, may be having a negative experience with the ATV4 as a whole.