You don't have to lift the phone to your face - you just have to look at the phone.
Most of the time when I unlock I'm holding the phone a bit higher than waist level - upper arms straight down, elbows/forearms bent 90-degrees, right where it's most comfortable for my fingers/hands to operate the touchscreen. I glance down at the screen (I do have to see what I'm touching) and it unlocks.
Most of the "I prefer Touch ID" posts I read extol the benefits of unlocking while they are removing the phone from their pocket. Yes, that's a "quick draw" in the tradition of the Wild West, but my iPhone X with Face ID unlocks very quickly - I don't feel like I'm losing time/waiting for something to happen.
There are times when unlocking is more of a challenge - if the phone is lying flat on my desk I have to tilt it because the camera and sensors are pointed straight up, rather than at my face. I also had issues with getting Touch ID to read - damp fingers when I've been working in the kitchen, wearing gloves while hiking, etc. Both methods have their strengths and weaknesses, but overall a glance at my phone works better for me than having to place a finger on the Home button.