ok. we can go off on the tangent.
1.Lidar measures distance. Where things actually are. a camera doesn't measure depth, only estimates it based on 2d pixels via parallax and motion between frames. Vision only systems consistently fail based on misreading flat frames.
2. Liadar works regardless of light conditions. It is illuminating the scene itself, it's an active sensor. T
I've developed apps using iPad's lidar. I've worked with the point clouds. I'm well versed in how lidar works.
The Camera on the other hand is a passive sensor and is only as good as the ambient light its handed. when you exit a tunnel into the sun, night driving. Cameras aren't perfect, and it only takes split seconds to crash a car.
3. Cameras being block or glare, have no back up. if your front facing cameras are disabled by glare. What data does the car use?
This is great, we can get down to the nitty gritty technical details.
Tesla's camera sensors have 19 stops of dynamic range (12 bit sensors). Human at any given point typically sees 14 stops. Of course human eyes can adapt to different brightness to get the full 20 stops but Tesla's camera sensors can capture 19 stops at an instant.
There are plenty of samples by a Tesla hacker named "greentheonly" who ran tests to see how cameras look at the sun and in pitch black (plenty of details are kept).
Now, the HW3 chip operates on 10-bit which discards some info (and that's why you see video clips of Tesla cars failing in glare). But AI4 chip operates on the full 12-bit. Can it still get glares? Sure, but it'll fail at a point where even a human can't see in that glare.
TL;DR, camera sensors see better than a human. As long as it sees better than a human, it's enough for autonomy. It doesn't have to be perfect.
4.multiple cameras may be redundant, but its redundancy with the same technology. a single modality system will have a single fail point.
A Waymo doesn't drive with only lidar. That's not how it works. Waymo sensor fuses all the data and then runs inference on that data. The supposed benefit here is higher accuracy when a camera picks up on an object.
If the camera sensors completely fail, Waymo will simply stall. It will not switch into some backup mode and drive with only lidar sensors like usual.
5. adverse weather conditions hit cameras hard. rain, fog, snow, dust... all disruptive to the camera sensors. lidar punches through. if you can't see... can you drive? when visibility collapses, lidar can carry on.
Lidar does not "punch through" rain. In fact, it's even worse for a multimodal system because you have noise contributing to lidar point clouds and cameras. Then you have sensor contention where lidar might make out an object that a camera system doesn't pick up on. Do you trust lidar or trust cameras?
Sensor contention is what caused Waymo to crash into a telephone pole. Lidar picked up a telephone pole but the camera system didn't really pick up on a super thin object so Waymo "assigned a low damage score" on the telephone pole and rammed into it.
The claim that "humans drive with only vision" may be true, but our eyes are far more capable than the cameras
Untrue. Explained above.
the Autonomous vehicle needs to be more capable than a human driver.
sure. an autonomous system is aware 24/7 with 360 degree vision.
we should not accept any less than perfect.
100% disagreed. millions of people die every year from car crashes. if a system reduces the death by 99.9%, you're still going to hold off on deploying a system because you need to chance that 0.1%?
That makes no sense. And Waymo, the thing you talk so highly of, crashes/stalls often.
so my question to you is why does vision alone seem adequate for you? there are clearly challenges that you have to address as well.
I've explained above.
Your claim that contention is a problem is not incorrect, let's assume we have an autonomous vehicle with cameras and Lidar and that contention problem is solved
If you can "assume" that, you can "assume" it's solved with cameras only.
, as problems can be... now what? as for Waymo they will fix the issue and the cars will be back on the freeway with an even more robust system.
And Tesla can solve issues and deploy on freeways too.
now can we get back to CarPlay? why is CarPlay so important to you?
You really didn't address the Waymo hitting a telephone pole. You just made an argument saying "assume that content problem is solved". That's not a proper response to the issue I'm pointing out.