Live data from Hacker News

Tesla’s Autopilot found partly to blame for 2018 crash on the 405

latimes.com

161–170 of 236 posts

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#161
post #81

Earlier quoted context omitted.

It only highlights how incredibly dumb these autopilots are. They’re incredibly diligent but completely fail at the necessary skill of understanding . What is the point of any of this if the car with all of its sensors knowingly plows into a stationary red 30-ton obstacle. It’s something that a 4 year old human would understand instantly as an object to be avoided at all cost. I really think folks don’t realize how c…

While "human understanding" would be nice, detecting big solid obstacles is a solved problem. It just costs money. Until somebody orders enough LIDAR units to get the cost down. Tesla's "autopilot" collisions are all very similar. They're all "hit big stationary obstacle that wasn't the rear end of a car". So far, a fire truck, a street sweeper, a stalled car at a freeway median, a crossing semitrailer, and two freew…

you do not need LIDAR to recognize a stopped vehicle, higher powered visual processing will suffice.

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#162

The driver was found using his phone, over-relied on the autopilot system, and lied about what he was doing when being questioned. Sadly, we can't 100% trust these automated driving systems yet so folks need to stay attentive behind the wheel. The more accidents like this will cause lawmakers to create laws that can potentially slow down automated driving development.

>Sadly, we can't 100% trust these automated driving systems yet so folks need to stay attentive behind the wheel. And companies selling the systems need to stop calling them "Autopilot". >The more accidents like this will cause lawmakers to create laws that can potentially slow down automated driving development. You'll actually hear this from people working on self-driving at most companies. That they have deliberat…

Realisticly, Tesla has done more for self-driving cars than any company in the world. It is almost synonym with self-driving car. Mistakes are inevitable no matter what you do, so I would be careful with your last statement.

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#163
post #108

Earlier quoted context omitted.

Because self driving car companies are putting a dangerous product onto the road, citing “safer than human drivers” in a disingenuous manner. Musk likes to cite autopilot as safer than human drivers, based upon accidents per miles driven. However, where are autopilot miles primarily being driven? On the highway. I expect a sober human driver to have a much lower accident rate than Tesla’s autopilot when driving the s…

> I have to ask myself if I would have been able to avoid those, and I can honestly say that I would have. This is not the whole equation. The question is also would you be able to react to all accidents that Autopilot is avoiding? Are you 100% diligent ALL the time? Can you react in 200 ms ALL the time to someone else stupidity? Last-minute breaking for the exit, veering into your lane, speeding trough crossroad on…

I’m not the only one questioning these claims:

https://qz.com/1414132/teslas-first-accident-report-claims-i...

Tesla’s autopilot miles are primarily driven on highway miles (in low speed, bumper to bumper Bay Area/LA traffic), in new cars (with well engineered safety cages and multiple airbag systems) which are well maintained (Tesla owners are unlikely the be driving on bald tires and experience blowouts), unlikely to rollover (one of the most fatal accident types) due to battery weight distribution. The car, without autopilot, is much less likely to experience fatal accidents. Couple that with the type of autopilot miles driven, and I expect sober human drivers in the 30-69 age bracket would have been less likely to experience accidents in those same miles.

I expect Tesla is intentionally trying to cloud the statistics to build the public narrative that self driving cars are safer. I believe that Tesla truly expects them to be safer eventually, but they’re smart enough to have the numbers on equivalent human driver crash rates... I’m sure that data was compiled by a very energetic Tesla engineer, put into an power point deck and emailed around. Perfect for a lawyer to subpoena.... and prove that Tesla knew their product wasn’t.....

And Tesla isn’t the only self driving aspirational car company pushing the “self driving cars are safer narrative”. Even Waymo (or maybe the media) claims their vehicles are involved in fewer accidents per mile... but they’re not self driven cars. They’re self driving cars with a human overriding the car’s decision every ~10k miles. Human drivers have an accident approximately every 500k miles (eliminating the under 25 and over 70 age bracket, and non-sober drivers - I expect that number to be closer to an accident per 500k-1M miles). So, a self driving car, without a human, would have been in some type of bad situation 50 times in those 500k miles a human would have driven with just one accident. My suspicion is that in a high fraction of those 50 disengagements, there would have been an accident had a human not intervened. My real suspicion is that self driving cars without human supervision are 50-100x worse than humans.

Lawyers are the only ones who are paid to figure out if my statistical assumptions are correct and to bring them to light.

And yet, I drive with Tesla Autopilot every day. Why? Because I believe that on a portion of my commute, it’s absolutely a better driver than I am. That portion of my commute is straight high speed traffic, periodically interrupted by people slamming on the brakes. It’s boring and mentally draining at the same time. I wish everyone on that portion of the freeway was driving with Tesla autopilot, as accidents are the major cause of my commute delays. Those 20 miles of new, well maintained, straight, properly marked freeway miles, driven during perfect weather, not into the sun, are ideal for Tesla autopilot. Nobody should take those ideal miles and extrapolate them to the rest of my much more dangerous commute.

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#164

Earlier quoted context omitted.

It's still misleading, because the miles driven with Autopilot are only a subset of total possible miles, and specifically are a _smaller_ subset of total possible miles than "normal driving". To wit, if Autopilot is unavailable or disengaged because of poor weather/road conditions, a human still has to drive those miles. Autopilot gets the _best_ conditions to show its abilities. Humans get all conditions to show th…

As I said, whatever the reason, there are less accidents with Autopilot, than without. Autopilot is a convenience feature. The question is: Are you willing to accept only 33% less likely hood of an accident with autopilot engaged as compared to when you drive on your own in not Autopilot safe conditions? Do you use Uber knowing that their average driver will be ... well ... average, or just somewhat better than avera…

He has a point, right? There's a possibility of clear sampling bias: if there are X miles that are safe and Y miles that are dangerous and autopilot can only be engaged in the X miles, then it's not creating safety, but the partitioning will cause it to appear to be safer than the human. If the partitioning had been done without autopilot the two partitions may show similar behaviour.

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#165
NTSB Report here: https://ntsb.gov/investigations/AccidentReports/Reports/HAB1... (found it here: https://www.theverge.com/2019/9/4/20849499/tesla-autopilot-c...)

Copying: When the last lead vehicle changed lanes—3 to 4 seconds before the crash—revealing the fire truck on the path of the Tesla, the system was unable to immediately detect the hazard and accelerated the Tesla toward the stationary truck. By the time the system detected the stationary vehicle and gave the driver a collision warning—0.49 second before impact —the collision was imminent and the warning was too late, particularly for an inattentive driver. The AEB system did not activate. Had the driver been attending to the driving task, he could have taken evasive action to avoid or mitigate the collision.

So there you have it: "particularly for an inattentive driver".

Not really an expert in the field, but I think a major problem with self-driving in general is handing over from an autopilot to a human. This is something that cannot be easily solved just by throwing smarter technology at the problem. Even if autopilot technology manages to be reliable 99.9% of the time, this won't be good enough, because people will invariably think they can rely on it 100% of the time and fall asleep or get distracted. So this 0.1% can be potentially catastrophic, because you cannot go from being asleep to full alertness in 0.5 seconds. Besides, even if one actually wants to maintain alertness, it may be harder to be alert and not doing anything than being alert and doing something (driving).

So, unless autopilots can really really handle anything thrown at them, this will be a real issue. Although there is much willingness for people to convince others and be convinced that this kind of autopilot is very close to being a reality, I suspect it may be not.

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#166

Fire truck driver here: People crash into parked fire trucks and ambulances and cop cars all the damn time . That's why we park the Big Red Truck at an angle behind the accident -- so that when the 2-ton car crashes into the 30-ton truck, the car will bounce off and the people behind the truck (us) won't be injured. I don't disagree that Tesla's software is partly to blame here, but the null experiment also has a lou…

As another fire engine driver (now officer), this is why more and more departments are employing "blocker engines", old decommissioned, stripped engines to provide this security, without risking a $500,000 engine to $1.5MM tiller. Also, anything that fails to assume that emergency traffic may be at a vastly differing speed from other traffic, or that emergency lights should _almost exclusively result in an autopilot…

> this is why more and more departments are employing "blocker engines", old decommissioned, stripped engines to provide this security, without risking a $500,000 engine to $1.5MM tiller.

That's pretty clever. I don't know why I didn't think of that myself.

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#167
I worry much more about public overreaction to rare incidents slowing and overregulating self driving technology than I do about the rare crash here and there. Overall statistical safety is what matters, and statistics goes out the window when the public emotionally fixates on specific mishaps and demands regulation that slows and cripples overall-safe technology.

Everyone believes, without reason, that he is a good driver and will always beat those janky autopilots. HN threads about autonomous vehicles are always full of unrepresentative anecdotes and angry moral denunciations of technology. It's sad.

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#168

Fire truck driver here: People crash into parked fire trucks and ambulances and cop cars all the damn time . That's why we park the Big Red Truck at an angle behind the accident -- so that when the 2-ton car crashes into the 30-ton truck, the car will bounce off and the people behind the truck (us) won't be injured. I don't disagree that Tesla's software is partly to blame here, but the null experiment also has a lou…

As another fire engine driver (now officer), this is why more and more departments are employing "blocker engines", old decommissioned, stripped engines to provide this security, without risking a $500,000 engine to $1.5MM tiller. Also, anything that fails to assume that emergency traffic may be at a vastly differing speed from other traffic, or that emergency lights should _almost exclusively result in an autopilot…

> As another fire engine driver (now officer), this is why more and more departments are employing "blocker engines", old decommissioned, stripped engines to provide this security, without risking a $500,000 engine to $1.5MM tiller.

Very interesting idea! You wouldn't even need a dedicated bay for it because who cares if it gets faded in the sun or rained on? An old tender that still holds water would be perfect for this.

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#169

Earlier quoted context omitted.

We need to look at driverless a different way and I suspect this is why it's going to be hard to accept driverless for longer than we need to. Computers look at the world in a different way. So they are going to have accidents that seem very obvious to humans making people go "look how bad driverless is because a human would never...". Many people will take that as a reason to avoid driverless tech. Yet driverless wi…

I can't speak for others, but while this is true in aggregate, I'm not personally willing to stake my life on a system that can, on a 1-in-a-million event and with no warning, accelerate into a fatal collision. An otherwise 100% accident-free driving record matters not when I'm dead. The failure modes of these systems need to be much more gentle: when I'm confronted with an uncertainty while driving, I slow down and…

> while this is true in aggregate, I'm not personally willing to stake my life on a system

Why not? Statistically, you're safer with an autonomous system. Unless you're sure you're a much better driver than average, your position is irrational.

Re: Tesla’s Autopilot found partly to blame for 2018 crash on the 405

#170

NTSB Report here: https://ntsb.gov/investigations/AccidentReports/Reports/HAB1... (found it here: https://www.theverge.com/2019/9/4/20849499/tesla-autopilot-c... ) Copying: When the last lead vehicle changed lanes—3 to 4 seconds before the crash—revealing the fire truck on the path of the Tesla, the system was unable to immediately detect the hazard and accelerated the Tesla toward the stationary truck. By the time t…

There was an interview with George Hotz from comma.ai where he talked about this.

His fix is a very attentive driver monitoring setup. So if you are not paying attention, it will barf at you. IIRC he was also talking about how this driver monitoring setup is worth something in itself for trucking companies, fewer damages.

Post reply on HN