You can disable the attention setting, which Face detection won't focus on Your eyes. Just keep in mind Face ID isn't perfect, neither was Touch ID when it first launched.
I've used every iPhone since 3GS and every phone that has TouchID. Even TouchID wasn't 100%. There were always times it didn't work (through gloves, wet hands, or just for whatever reason). FaceID is the same. For me, who's had the X since launch, it works about 95% of the time. That's good enough for me.
My Touch ID probably works 85-90% of the time. I just put in passcode when it doesn't. My thumb print will only last a few days before it doesn't work. Right index finger is the best for me.
I've disabled the "need attention" option, which helps because I am not always looking at my phone. Otherwise, you should enter your passcode when it fails and it will learn your face more.
TouchID also fails once in awhile... or even frequently if you are sweaty. My understanding is that FaceID is always learning and adapting to changes in your face, so it should get better over time. Starting over would be counterproductive.