It's interesting how vague this is. There's an NTSB investigation still pending into a specific Tesla crash.[1] The goals are different. NHTSA asks "do we need to do a recall?" NTSB asks "exactly what, in detail, happened here?" NTSB mostly does air crashes, but occasionally they do an auto crash with unusual properties. Here's the NTSB report for the Midland, TX crash between a train and a parade float.[2] That has…
Yes, it does seem vague. Isn't the NHTSA investigation meant to be a non-biased root-cause-analysis about last year's trailer crash? Instead, this just seems to be a grading report on Tesla's autopilot compliance.
NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
301–310 of 327 posts
Re: NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
#302It's interesting how vague this is. There's an NTSB investigation still pending into a specific Tesla crash.[1] The goals are different. NHTSA asks "do we need to do a recall?" NTSB asks "exactly what, in detail, happened here?" NTSB mostly does air crashes, but occasionally they do an auto crash with unusual properties. Here's the NTSB report for the Midland, TX crash between a train and a parade float.[2] That has…
The only thing that matters is "NHTSA notes that crash rates involving Tesla cars have dropped by almost 40 percent since the wide introduction of Autopilot" Even if autopilot was faulty in some way, if more people were living than dying - does it matter?
If you let your friend drive you somewhere in your car because you think they're a better driver, is it their fault if they crash?
The reason could be anything - you're drunk and they're not, you're in really congested unfamiliar area near where they live, whatever. If you think they're statistically going to be a better driver it does not absolve them of liability. Someone is always to blame.
Re: NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
#303Earlier quoted context omitted.
The only thing that matters is "NHTSA notes that crash rates involving Tesla cars have dropped by almost 40 percent since the wide introduction of Autopilot" Even if autopilot was faulty in some way, if more people were living than dying - does it matter?
Well, yeah. Imagine there's heart surgery which has only 20% success rate. So every time 100 people go in for that surgery, only 20 survive. Now, someone makes a robot that has 100% success rate, but every 100 operations, it has a glitch in the sofware, where it stabs and kills the patient instead. It has been calculated that on average, using the robot only kills 1-2 out of 100 people going in for surgery, compared…
Step 2: Correct the bug, so the robot stops killing patients.
The Tesla autopilot may be in a similar situation. Even if there is a number of fatality inducing bugs, disabling it would be even worse. That said, 40% crash reduction is not enough. I want to see 75%, 90%, and more.
Re: NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
#304Earlier quoted context omitted.
Level 3 is the real danger area. That's the level where the driver is able to do other things, but must be prepared to retake control at any time. Those two ideas are basically contradictory: if you're not already involved with driving, it takes too long to get back into it to do anything useful. Tesla's system is level 2, meaning that the driver must (as in, is supposed to) remain engaged and aware of the driving ta…
There is zero chance I'd stay awake behind the wheel of a level 2 or 3 vehicle.
Modulating my speed keeps me engaged with driving and I use it as the trigger to cycle through my responsibilities. I check ahead / speed, adjust throttle, check rearview mirror, check left mirror, check right mirror, repeat. When the throttle step is gone I find myself losing siutational focus very quickly. I've always thought it was because it was the only action that involved actual physical engagement, all the rest are just eye movement.
I just bought a new car that alerts when it's below 4 degrees C about the possible icy conditions, but it only does so after the car has been running for several minutes. By the time it goes off I'm already driving and I mistake it for an engine warning or other catastrophic failure. Every time. I live in Canada, of course it's icy in the winter. Toddlers could have told you that. This is an absurdly dangerous thing to have the car do, because when the beep goes off all my attention is on processing the alert, not about the pedestrian I'm about to run over. I have the same basic fear about getting control of a level 2 or 3 car. All my focus will be on why the car is handing me control, not on the actual task of driving.
Re: NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
#305Earlier quoted context omitted.
This is a very simplistic way to look at it. We're in uncharted territory here. Did crash rates go down because driver error went down? Probably. So accidents for which the driver is liable go down a lot. And accidents for which the car-marker is liable go up a little. That last bit is still a very big deal.
Probably? Why do you think it likely that driver error would go down more than 40%?
Re: NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
#306Earlier quoted context omitted.
Yes, it does seem vague. Isn't the NHTSA investigation meant to be a non-biased root-cause-analysis about last year's trailer crash? Instead, this just seems to be a grading report on Tesla's autopilot compliance.
Section 5.3 pretty much sums up the root cause of this accident: the driver assist requires the driver to be alert, and the driver had 7 seconds to react and didn't. There's no requirement that driver assist software magically become self-driving software in that situation. Put another way: it's nice if the software can avoid a problem, but not required. The main remaining concern is that drivers not be confused abou…
Re: NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
#307Earlier quoted context omitted.
Well, yeah. Imagine there's heart surgery which has only 20% success rate. So every time 100 people go in for that surgery, only 20 survive. Now, someone makes a robot that has 100% success rate, but every 100 operations, it has a glitch in the sofware, where it stabs and kills the patient instead. It has been calculated that on average, using the robot only kills 1-2 out of 100 people going in for surgery, compared…
Step 1: don't recall the robot surgeon. While it does have a fatal bug, recalling eat would kill 79% more patients. Oops. Step 2: Correct the bug, so the robot stops killing patients. The Tesla autopilot may be in a similar situation. Even if there is a number of fatality inducing bugs, disabling it would be even worse. That said, 40% crash reduction is not enough. I want to see 75%, 90%, and more.
Re: NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
#308After looking at the report it looks like Tesla ran into the same issue we did in the 2007 DARPA Urban Challenge. The trailer was higher than the front facing sensors. We and most other teams had all assumed 'Ground Based Obstacles' meant that any obstacles on the test track would make contact with the ground in the lane of travel. DARPA decided to put a railroad bar across the street and expected cars to back up and…
I don't understand why the paradigm isn't about full volumetric prediction .. is it because people were too tired of solving all other issues (surely possible at the time of DARPA challenge, but Tesla had time and money since); or hardware limits (like scanning a larger area would impede signal quality or make processing too heavy ..)
Re: NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
#309Earlier quoted context omitted.
Besides, it's perfectly possible to fall asleep but with your hands still touching (even gripping!) the steering wheel.
That's also a solved problem - Mercedes cars have "attention assist" which can figure out how attentive you are by measuring how you drive. If you are literally falling asleep at the wheel, the system will get very annoying and insist that you stop for some rest. Of course, whatever algorithm they are using won't work if the car is driving itself, you can't judge the reaction time if all the driver is doing is holdin…
Re: NHTSA’s full investigation into Tesla’s Autopilot shows 40% crash rate reduction
#310Earlier quoted context omitted.
I don't understand why the paradigm isn't about full volumetric prediction .. is it because people were too tired of solving all other issues (surely possible at the time of DARPA challenge, but Tesla had time and money since); or hardware limits (like scanning a larger area would impede signal quality or make processing too heavy ..)
Which one seems more likely? "We could absolutely do that, but meh...just ship it already, who cares" or "doing that would require a major redesign, more sensors and more gigaflops"? (Okay, in the current hw/sw development paradigm, the first one doesn't sound as unlikely as it ought to)