Direct sunlight seems to be OK. It might take half a second slower (if that), but I normally don't have issues outside. Fluorescent lighting on the other hand, gives me the most issues. I've had to type my PIN in the office far too many times.
My coworker doesn't seem to experience my issues at my level, so I'll probably try setting up FaceID over again and see if that fixes the problem.