Live data from Hacker News

NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

arstechnica.com

351–360 of 546 posts

Re: NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

#351

This just reconfirms my belief about Tesla's "autopilot" --- most of the time it behaves like an OK driver, but occasionally makes a fatal mistake if you don't pay attention and correct it. In other words, you have to be more attentive to drive safely with it than without, since a normal car (with suspension and tires in good condition, on a flat road surface) will not decide to change direction unless explicitly dir…

You can't make that kind of conclusion from a single, extremely-highly-publicized occurrence, even a fatal one. Given how often human drivers kill people, you need statistics to show that autopilot is worse.

I'm going to need statistics from an independent source, not from Tesla, that autopilot is safer.

I'm not inclined to trust Tesla's statistics given how cavalier they have been about putting their shoddy autopilot product on the road and marketing it as being better than it actually is.

Re: NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

#352
post #294

Earlier quoted context omitted.

I'd prevent them from using the AutoPilot term, penalise them for marketing imagery that includes people driving with their hands off the wheel, and require hands to be on the wheel far more often. Until it's significantly improved, it should be a backup safety system rather than a driving and safety system.

> I'd prevent them from using the AutoPilot term I disagree. It's the same term as in aviation and does the same thing. > penalise them for marketing imagery that includes people driving with their hands off the wheel That's more reasonable.

> It's the same term as in aviation and does the same thing.

Except in aviation trained pilots with at least a decade of experience flying planes get to use it, understanding well the limitations and purpose of the technology. A teenager can use Tesla's "Autopilot".

Re: NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

#353

Earlier quoted context omitted.

A joke? It's verifiable because he said he might name it Pravda, and the fact that he actually registered it is further evidence that it's a joke? I'm not saying he's really going to do it, but I question your certainty here with a total lack of actual evidence.

Verifiably is a strong word on this site. Fair enough. I'm still right though. Options: * In 2018, A foreign-born Capitalist billionaire with sometimes negative press coverage suggests creating a Ministry of Truth named after a Russian propaganda newspaper to call out journalists who make false claims in their reporting. He registers a corporation for that purpose on the 100th anniversery of a bloody revolution bring…

Never been brigaded on HN before. What a feeling.

Re: NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

#354

Earlier quoted context omitted.

>This isn't an issue specific to Tesla as all automakers are now making cars that are more and more dependent on software. Cars have been dependent on software for a long time (literally decades). This isn't something new. Even combustion engine cars have had software inside of them that controls the operation of the engine, and this software is vigorously tested for safety issues (because most car manufacturers unde…

All cars from all manufacturers are running 10s or 100s of times more code than they did 10 or 20 years ago. https://skeptics.stackexchange.com/questions/39559/does-the-... This really affects the nature of the situation. 20 years ago, cars contained microcontrollers with a tiny bit of code which was thoroughly reviewed and tested by skilled professionals. Today, all cars run so much code, even outside of the enterta…

AI takes it to a whole new level. Neural networks are all black box, they can't be reviewed. You feed in your training data, you test it against your test data, and just have faith that it will respond appropriately to a pattern that's slightly different than anything it's seen before. Sometimes the results are surprising.

Re: NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

#355
post #307

Earlier quoted context omitted.

Yeah, because we know governments are really good at giving certifications and doing tests that mean sonething. Lets put every design decision in the hand of governements then! or better, nationalize car companies! Problem solved?

Flying in an airplane is safe because of direct intervention by the government. Cars have been made safe for us also by direct intervention by the government. From important things like mandating seat belts and crash safety to smaller things like forcing the recall of tens of millions of faulty air bag inflators. These are just a few of the many things Uncle Sam has done to make things safer for us.

Isn’t flying mostly safe because of post hoc safety analysis followed by operating requirements? I don’t think the FAA tests every change made to aircraft before they can fly?

Re: NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

#357

Earlier quoted context omitted.

I shouldn't have to keep saying this in every thread about Tesla autopilot, but I guess I do: the fact that there will probably one day be autonomous driving systems that are safer than human drivers does not imply that Tesla's current system is safer than human drivers.

I think it is safer. Its of course dependant on the situation ie. Highway cruising. But I think it is. (Human drivers are not that high of a bar, I see crashes at least weekly, on my stretch of highway)

Why are we comparing to humans? Shouldn't we compare autosteer to a human assisted by lane keeping assist?

Re: NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

#358

Earlier quoted context omitted.

And this is exactly why all of these articles recently about how "great" it is that Tesla sends out frequent OTA updates are ridiculous. Frequent, unpredictable updates with changelogs that just read "Improvements and bug fixes" is fine when we're talking about a social media app, but is entirely unacceptable when we're talking about the software that controls a 2 ton hunk of metal flying at 70mph with humans inside…

This seems testable. IANAAE (I Am Not An Automotive Engineer), but why can't you run both the new and old code side by side and if the actions they take are materially different investigate further? Like, if in one case the new code would want you to move left, and the old code goes straight, one of those behaviors is probably wrong. If the driver corrects, then the new code is probably correct, but if the driver doe…

It has already been touched on by another commenter, but testability of Machine Learned systems outside of a training dataset is pretty much a crapshoot.

An ML solution stops "learning" after training and only reacts.

To illustrate the difference, have you driven on roads under construction lately? As humans, when you've driven the same road hundreds of times, you start to do the same thing as a machine learned implementation. You drive by rote.

When you get to that construction zone though, or the lines get messed up, your brain will generally realize something has changed, and you'll end up doing something "unpredictable", i.e. learning a new behavior. The Machine Learning Ali's output (a neural net) can't do that. It can generify a pattern to a point, but it's behavior in truly novel circumstances cannot be assured.

Besides which, the problem still stands that the system is coded to ignore straight ahead stationary objects. Terrible implementation. It should look for overly fast and uniform increase in angular field coverage combined with being near stationary in terms of relative motion as a trigger to brake. I.e. If a recognized shape gets bigger at the same rate on all "sides" whilst maintaining a weighted center at the same coordinate. It's one of the visual tricks pilots are taught to avoid mid-air collisions.

Admittedly though, the human brain will likely remain WAY better at those types of tricks than a computer will be for a good long time.

Re: NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

#359

Earlier quoted context omitted.

>Cars have been dependent on software for a long time (literally decades). This isn't something new. Even combustion engine cars have had software inside of them that controls the operation of the engine, and this software is vigorously tested for safety issues (because most car manufacturers understand a fault with such software could result in someone's death). Tesla seems to be the only major car manufacturer that…

This comparison just sold me on how morally wrong it is what Tesla is doing. Intentionally misleading and marketing to customers a feature called Autopilot that is only a marginal improvement on what other cars already offer. What if Volvo started calling their (clearly not independent) feature Autopilot and saying it was the future of hands-free driving? Seems inexcusable.

Which is also exactly what GM is doing with Super Cruise. Here is just one of their commercials.

https://www.youtube.com/watch?v=u__51kTl4j8

Despite this warning in the manual[1]:

>Super Cruise is not a crash avoidance system and will not steer or brake to avoid a crash. Super Cruise does not steer to prevent a crash with stopped or slow-moving vehicles. You must supervise the driving task and may need to steer and brake to prevent a crash, especially in stop-and-go traffic or when a vehicle suddenly enters your lane. Always pay attention when using Super Cruise. Failure to do so could result in a crash involving serious injury or death.

[1] - https://www.cadillac.com/content/dam/cadillac/na/us/english/...

Re: NTSB: Autopilot steered Tesla car toward traffic barrier before deadly crash

#360
post #105
post #76

Earlier quoted context omitted.

> The paint on the right edge of the gore marking, as seen in Google Maps, is worn Indeed; here's a close-up of the critical area. Note that the darker stripe on the bottom of the photo is NOT the crucial one; the one that the car was supposed to follow is the much more faded one above that that you can barely see: https://www.google.com/maps/@37.410912,-122.0757037,3a,75y,2... (Note that I'm not blaming the faded pa…

Wow. The start of that concrete lane-divider looks incredibly dangerous for a highway. It pretty-much just "starts", with only some sort of object that they call a "crash attenuator" in front of it. I would imagine its purpose is to dampen/dissipate kinetic energy and maybe deflect oncoming objects from hitting the concrete slab directly. I don't even see any sort of road-bumps to warn drivers of this dangerous obsta…

The crash attenuators are usually good enough to save people's lives. There are small grooves in the sides on some of the freeways in CA but they aren’t everywhere.

The problem with the attenuators are that they don’t get replaced fast enough which makes these accidents a lot deadlier.

You can see the difference between a used and unised attenuator in this article. http://abc7news.com/automotive/tesla-claims-missing-safety-b...

Post reply on HN