Live data from Hacker News

Tesla is ordered to turn over Autopilot data to a federal safety agency

nytimes.com

71–80 of 192 posts

Re: Tesla is ordered to turn over Autopilot data to a federal safety agency

#71

Earlier quoted context omitted.

There is absolutely a good reason for adaptove cruise control systems to ignore stationary objects: https://arstechnica.com/cars/2018/06/why-emergency-braking-s...

Which is...linking a Wikipedia article? Doesn't quite compute.

Was a copy / paste failure. Meant to grab this link:

https://arstechnica.com/cars/2018/06/why-emergency-braking-s...

Re: Tesla is ordered to turn over Autopilot data to a federal safety agency

#72
post #28

Let's ignore the larger point (which is that this is just one of a million possible edge cases where autopilot could systematically fail), I could absolutely see Tesla just bodging in a "If you see emergency vehicle lights flashing disengage" - it'd perfectly reasonable to say that you shouldn't be using autopilot in that situation because you should be paying attention and ready to react to the emergency vehicle.

It should warn and turn off in a LOT of situations imo; there was another accident in a construction zone where the car hit a barrier, for example. And there's the shared videos of people literally sleeping or sitting in the back seat of a Tesla on autopilot; the car should detect that and disable autopilot for an X amount of time. Of course, at the same time the car should not play police; if someone is caught doing…

It should warn and force the driver to confirm to keep autopilot going at set speed. Same way it handles traffic lights and autopilot.

Re: Tesla is ordered to turn over Autopilot data to a federal safety agency

#73

Earlier quoted context omitted.

> 12 crashes into vehicles with flashing lights on them doesn't sound like great success from Autopilot, gonna be honest. I'm sorry, but how can you form an opinion so quickly? 12 crashes out of what? Any number? 12 crashes out of 10000000 scenarios sound like a pretty good record, while 12 crashes out of 15 scenarios indeed doesn't sound like a great success. But what information do you have that the rest of us does…

There is enough information here though. These are situations where failure is not suppose to happen when the driver is paying attention. Given that the auto-pilot is always paying attention when operational, this becomes an unacceptable failure mode because it failed in the most rudimentary way - failure to perceive stationary obstacles and a display of complete lack of situational awareness. For emergency responder…

[deleted]

Re: Tesla is ordered to turn over Autopilot data to a federal safety agency

#74

The absolving argument that it's still the drivers responsibility to intervene has flown out of the window with this request. The federal safety agency is not having any of that excuse anymore. They might find that Tesla did no wrong here, further enabling Tesla to get away with this. But this looks a lot like they want to regulate the feature a bit more. If self regulation via companies and humans does not work, the…

I suspect humans are really bad when they only have to sorta pay attention and it results in just not paying attention a great deal of the time.

I'm not sure that's fixable on the human end.

Re: Tesla is ordered to turn over Autopilot data to a federal safety agency

#76
post #74

The absolving argument that it's still the drivers responsibility to intervene has flown out of the window with this request. The federal safety agency is not having any of that excuse anymore. They might find that Tesla did no wrong here, further enabling Tesla to get away with this. But this looks a lot like they want to regulate the feature a bit more. If self regulation via companies and humans does not work, the…

I suspect humans are really bad when they only have to sorta pay attention and it results in just not paying attention a great deal of the time. I'm not sure that's fixable on the human end.

The question is, how much of that is Tesla’s fault? They’re an EV company, not a psychology consultancy. We don’t hold gun manufacturers or alcohol companies liable when people do stupid things with their products, despite the best efforts of their marketing divisions. Granted “pull trigger get bullet” is much simpler than the Autopilot response.

Re: Tesla is ordered to turn over Autopilot data to a federal safety agency

#77

The absolving argument that it's still the drivers responsibility to intervene has flown out of the window with this request. The federal safety agency is not having any of that excuse anymore. They might find that Tesla did no wrong here, further enabling Tesla to get away with this. But this looks a lot like they want to regulate the feature a bit more. If self regulation via companies and humans does not work, the…

IMO this is a good thing, and should be applied to all manufacturers of driver-assist technology. Tesla has certainly been at the bleeding-edge of overly optimistic and confusing marketing for their product, but others should be on alert too.

Re: Tesla is ordered to turn over Autopilot data to a federal safety agency

#78
post #53
post #37

Earlier quoted context omitted.

"I'm sorry, but how can you form an opinion so quickly?" It doesn't really matter. They're stationary objects; there's absolutely no reason, good or bad, for the algorithm to determine that the correct trajectory change is into the stationary object. Humans crash into stationary objects because they're lacking attention almost 100% of the time, whether it's because they're half asleep, drunk, texting, or distracted b…

I can't find the specific comment now, but on previous autonomous driving discussions here, it's been asserted that Tesla (and many other systems) simply can't reliably detect stationary objects at speed. If the systems actually did a naive, "that looks like a stationary object, I'm going to avoid it" they'd barely be able to move in a highway setting.

AFAIK, it can detect them just fine, but it is bad at discriminating those its collision avoidance part should pay attention to from those it shouldn’t pay attention to (e.g. the road surface, traffic signs on the side of or over the road), so they (¿mostly?) chose to ignore all of them.

Re: Tesla is ordered to turn over Autopilot data to a federal safety agency

#79
post #74

Earlier quoted context omitted.

I suspect humans are really bad when they only have to sorta pay attention and it results in just not paying attention a great deal of the time. I'm not sure that's fixable on the human end.

The question is, how much of that is Tesla’s fault? They’re an EV company, not a psychology consultancy. We don’t hold gun manufacturers or alcohol companies liable when people do stupid things with their products, despite the best efforts of their marketing divisions. Granted “pull trigger get bullet” is much simpler than the Autopilot response.

We ask airplane makers to make adjustments to better indicate problems / auto pilot status when humans don't do the right thing all the time. And that's for professionals who get tons of training.

We have all sorts of car / road safety features because humans are bad at driving.

We can't reprogram the humans, can change the environment they operate in.

Re: Tesla is ordered to turn over Autopilot data to a federal safety agency

#80
post #53
post #37

Earlier quoted context omitted.

"I'm sorry, but how can you form an opinion so quickly?" It doesn't really matter. They're stationary objects; there's absolutely no reason, good or bad, for the algorithm to determine that the correct trajectory change is into the stationary object. Humans crash into stationary objects because they're lacking attention almost 100% of the time, whether it's because they're half asleep, drunk, texting, or distracted b…

I can't find the specific comment now, but on previous autonomous driving discussions here, it's been asserted that Tesla (and many other systems) simply can't reliably detect stationary objects at speed. If the systems actually did a naive, "that looks like a stationary object, I'm going to avoid it" they'd barely be able to move in a highway setting.

There are systems that can detect stationary objects, Tesla does not want to use those more reliable systems, so they use the programming methodology of tweaking tweaking the code when a bug appears and hope that was the last one.

Sure some AI gurus will claim that humans can detect this objects only with 2 eyes but they forget to mention that behind those 2 eyes is a brain an actual intelligence that is aware of the world and it's place in the world. So if you can't create an actual intelligence then at least put the effort in feeding correct data into your AI and remove the line of code "if static object ignore because too hard to detect if is a truck or a shadow/paper bag/sign"

Post reply on HN