More likely, it'll be something terrible (kids doing chalk drawings in the driveway?) Their system doesn't avoid a stopped car at the side of the road - will it recognize kids huddled on the pavement?? *shudder* Anyone with kids should be taking their Tesla's in and having this feature disabled...hard disabled - don't even have the damn code in their car.
Meanwhile, people are backing their SUVs over their kids in driveways, due to limited visibility and inattention. This is an actual thing. Shouldn't there be equal - or more - outrage/concern about current things causing actual vehicle-involved child fatalities in driveways, vs. getting worried about what
might happen?
And it's not like the code is going to leap out from behind a tree and bite you. Just don't use it. Airbags could kill you. They're pretty much a loaded gun pointed at your face. Everyone should be taking their cars in and demanding to have the airbags removed - don't even have the damn things in their car. And why limit the warning to "Anyone with kids"? By the same logic, wouldn't you want to demand the code be removed from the cars of anyone who visits you who has a Tesla? They might pull into your driveway, too. And your neighbor, or some random stranger (or their car) might even pull into your driveway simply in the process of turning around.
The interesting part is, the article doesn't give much context for the crash. The stopped car might have presented quite suddenly (say, coming around a bend in the road), and the car's options could easily have been limited by having other cars alongside: braking is insufficient to keep from hitting the stopped car, but if you swerve right, you push the car next to you into a busload of nuns - what action do you take?
The really interesting part is, how should a car respond in such a situation? How would a human respond? Different (and differently trained) humans might respond in a variety of ways. And humans might swear up and down that they would respond one way, but then actually do something quite different if the situation presented itself. Computers can make a decision faster, and based on more data, than a human, in such a circumstance, but the computer can only take into account the factors that were programmed in when the code was written. The long-term solution is, make such situations orders of magnitude less frequent (if the stopped car was transmitting its status to some hypothetical traffic conditions system, or, say, road monitoring cameras detected the non-moving mass in the roadway, then the Tesla-or-whatever could know to slow before reaching the stopped car), but it will be
very interesting to see how such systems get programmed in the future - do the companies optimize for least liability? least loss of life? least property damage? most lawful? or some combination of these factors? or something else entirely? What if "most lawful" conflicts with "least loss of life"? How would you have it decide between two options, one of which gives a small likelihood of causing a death and another which gives a high likelihood of causing major injuries (losses of limbs for multiple people, say)? Do you give preference in otherwise equal scenarios, to solutions that save the occupants of the car in preference to other people*, or the reverse? (And what does it do to your company's reputation/sales if the public learns that
your cars are programmed to sacrifice their occupants in order to save bystanders?) A human driver will simply do what seems like the right thing (or more cynically, the thing most beneficial to them) at the time, taking into account their sense of right and wrong, but also current mood and a whole range of life experiences. Given sufficient input, the computer can evaluate all the data and make the decision quicker than you, but it can only follow the instructions it's been given.
*: (I once heard a caller on a talk show explaining with some enthusiasm how he had been in an collision while he and his family were in a Lincoln Navigator, and the other guy was in some small economy car, and the guy in the other car
died, and the caller was very enthusiastic about how the Lincoln Navigator had protected his family and boy was he glad they were driving one and he was totally going to continue to buy them in the future... giving no consideration whatsoever to the idea that maybe, if he hadn't been driving a 6,000lb Armored Personnel Carrier - uh, SUV - the guy in the small car might have lived through the accident.)
(And just for fun, imagine malware that optimizes for
most loss of life, and pushes the busload of nuns over a cliff. New terrorist threat?)
[doublepost=1471284434][/doublepost]
Cars have cruise control which is a perfectly ok term for cars. Planes have autopilot which allows pilots to remove their attention from keeping the plane at a certain altitude or direction. Very different things.
Well, technically, the autopilot in the car also lets the driver remove their attention from keeping the car at a certain speed or direction. In both cases, the driver/pilot needs to be keenly aware of what is in front of them. If your plane runs into another, saying "but I had the autopilot on" won't help.