It really isn't a big deal for me. 99.99% of the time, I'm holding my phone when I want to use it.
I often lay my phone on the table next to my laptop and open it to check things like quick notifications I also use it laying in bed side ways in the dark there are many other examples. All of which I do not have to pick my phone to be in a direct horizontal line of my face to unlock it.