You're a rare bird. Someone who considers all the possibilities all the time while driving. The vast majority of drivers have no idea what is going on in the head of the very best drivers, and the software is reflecting that. I'm over two million miles crash free. I've never had an incident. Nothing, after spending the majority of my driving time in the worst imaginably congested cities. I'd expect you're similar. I think the average self driving software is at about 100k per incident. For people like us, being forced to let a computer take over is mortifying.
I've driven for work for 7 years at a previous job, so I can relate with you (no incidents).
I do like the idea of forward-collision prevention tech on regular cars as I think that having an extra set of "eyes" to make sure you don't hit something.
The problem with driverless cars is getting them to "see" the world around them and interpret it correctly. There are endless variables and situations which it has to be able to distinguish and act upon, relying primarily on camera data which then has to be processed to figure out what it "sees".
It'll be a while before they can reliably drive around in the snow, for example, as it's difficult for them to figure out where the road is precisely.