Live data from Hacker News

After 6 months of working fine, Tesla software update drives at barriers again

np.reddit.com

341–350 of 351 posts

Re: After 6 months of working fine, Tesla software update drives at barriers again

#341
post #128

Earlier quoted context omitted.

Your hands. If you're just resting them on the wheel, that's not enough to prevent the attention monitor from working, it actually has to measure some physical resistance. If you resist the automatic inputs too much, the AP cuts out. You can test this yourself in a tesla by engaging cruise control, then hitting a turn signal. This would normally initiate an automatic lane change - but keep your hands tightly on the w…

> Your hands. Sure, if you react fast enough. Let's not lose the plot here. The original claim was: "The AP can only kill you if you're distracted/asleep at the wheel and not paying attention." (Emphasis added.) And that's not true. It can kill you, quite simply, by producing the wrong control input in a situation where the available recovery time is less than your reaction time. If you doubt this, then I challenge y…

What I'm trying to imply is that "not paying attention" is exactly what happened here.

The "attention checking" has a delay of a few seconds on it before it'll start warning you to grip the wheel. If your hands were on the wheel, and you were paying attention, there's no reaction time, since the erroneous control input would be overridden by your hands keeping you in your lane.

Put simply, if your grip on the wheel was loose enough to where the computer-generated move could physically move the wheel, you weren't in control of the vehicle and would be generating warnings.

Re: After 6 months of working fine, Tesla software update drives at barriers again

#342
post #128

Earlier quoted context omitted.

> Your hands. Sure, if you react fast enough. Let's not lose the plot here. The original claim was: "The AP can only kill you if you're distracted/asleep at the wheel and not paying attention." (Emphasis added.) And that's not true. It can kill you, quite simply, by producing the wrong control input in a situation where the available recovery time is less than your reaction time. If you doubt this, then I challenge y…

What I'm trying to imply is that "not paying attention" is exactly what happened here. The "attention checking" has a delay of a few seconds on it before it'll start warning you to grip the wheel. If your hands were on the wheel, and you were paying attention, there's no reaction time, since the erroneous control input would be overridden by your hands keeping you in your lane. Put simply, if your grip on the wheel w…

No, it wouldn't. Having your hands are on the wheel doesn't insure that you're paying attention. And if you need to be paying attention 100% of the time anyway, what's the point of having an autopilot?

Re: After 6 months of working fine, Tesla software update drives at barriers again

#343
post #205

Earlier quoted context omitted.

For all driving protocols P, and accidents A, P would have zero fatalities if it switched to a better protocol just before encountering the situation that led to A.

That's exactly what I am trying to say. Yet Tesla implies their tech is statistically superior to human drivers, yet can disengage at any time.

Ah okay. Sorry, easy to misread people on this topic.

Re: After 6 months of working fine, Tesla software update drives at barriers again

#344
post #106

Earlier quoted context omitted.

I don't want to dismiss your whole point, because it is certainly valid, but that isn't really the issue here. It is entirely possible for bugs like this to exist in the self driving tech and for Tesla to be correct in their claims that Autopilot is on average safer than a human driver. It is obviously troubling to see self driving cars run into solid and stationary objects, but human drivers do that all the time too…

> see self driving cars run into solid and stationary objects, but human drivers do that all the time too. Human drivers who are distracted do that all the time, AP is supposed to avoid that, it is supposed to be alert all the time, but when it sees a stationary object, the result of their algo is, "it must be a sign we can somehow go through" We need to make it very clear that self driving cars are better than drivi…

It’s far from clear in the statistics that self driving cars today (without the use of a safety driver) are safer than driving drunk. IMO Tesla autopilot, fairly clearly is less safe than driving drunk if a human is not carefully monitoring.

Re: After 6 months of working fine, Tesla software update drives at barriers again

#345
post #342

Earlier quoted context omitted.

What I'm trying to imply is that "not paying attention" is exactly what happened here. The "attention checking" has a delay of a few seconds on it before it'll start warning you to grip the wheel. If your hands were on the wheel, and you were paying attention, there's no reaction time, since the erroneous control input would be overridden by your hands keeping you in your lane. Put simply, if your grip on the wheel w…

No, it wouldn't. Having your hands are on the wheel doesn't insure that you're paying attention. And if you need to be paying attention 100% of the time anyway, what's the point of having an autopilot?

But having your hands off the wheel absolutely does mean you aren't paying attention. Which is why Tesla and most other self-driving systems I'm aware of check for it. It's a negative signal, not a positive one.

>And if you need to be paying attention 100% of the time anyway, what's the point of having an autopilot?

The same reason cruise control is a thing on every modern car. It down on fatigue, which in turn, should improve safety and comfort. You're still required to be in control of your speed, but the vehicle manages keeping you at the set speed.

Re: After 6 months of working fine, Tesla software update drives at barriers again

#346

Earlier quoted context omitted.

So... Two planes falling out of the sky, killing 400 shouldn't be taken as proving anything? Or how about 1 stupid decision by a radiotherapy machine? Ever heard of THERAC-25? In each case, it was just 1 stupid decision by a machine. The entire reason Engineering as a practice is a thing is because when you implement the capacity for a stupid decision into a system that is then mass produced, dire consequences can re…

And people have died and been paralyzed as a direct result of the flu vaccine. Death and paralyses that would not have occurred had they not received that vaccine. Does that mean the flu vaccine should get dumped in the refuse bin? Similarly, some other aircraft flying today/tomorrow has automation with an unknown bug/issue that will cause loss of life. Should we disable everything except the 6-pack and stick and rud…

Does that mean you believe the decision to ground 737 max 8s is incorrect?

Re: After 6 months of working fine, Tesla software update drives at barriers again

#347
post #287

Earlier quoted context omitted.

And if your trip on autopilot is 99.9% reliable, how would you feel about that stat? Do you find yourself paying attention to the road context the entire time? I'm curious if your mental acuity has dropped over time as the car has driven you.

You start trusting it more as you use it and learn its flaws, so you can anticipate when it may do something stupid. I pay attention the entire time, but it is a much more relaxed experience. I’d still pay attention the entire time even if it were supposedly 100%. It is very sad that a lot of people in this forum are hoping this never works. It is one of the most exciting advancements in technology that can benefit u…

[deleted]

Re: After 6 months of working fine, Tesla software update drives at barriers again

#348
post #221

I think Tesla eventually has a catastrophic accident and is sued and/or criminally prosecuted into oblivion. I feel sorry for the people who are going to have to die for this to happen. This trope that humans are bad drivers is, in general, crap. Humans are very good drivers. The US has 7.3 deaths per billion km driven. This means if you drive 50km a day, every day, you are (essentially) guaranteed to die... after 75…

You're looking at it strictly from a safety perspective which is a small part of the whole picture. If we looked at transportation from a safety perspective throughout history, we'd still be walking everywhere. What's the risk of crashing and dying while walking? Zero; it's fully optimized for safety. We rode horses and now drive cars to save time. Driving to work is unquestionably a better experience than riding a h…

"What's the risk of crashing and dying while walking? Zero; it's fully optimized for safety."

Huh? Have you never seen or heard of anyone falling, hitting their head, and causing a concussion and/or death?

Re: After 6 months of working fine, Tesla software update drives at barriers again

#349
post #276

I think Tesla eventually has a catastrophic accident and is sued and/or criminally prosecuted into oblivion. I feel sorry for the people who are going to have to die for this to happen. This trope that humans are bad drivers is, in general, crap. Humans are very good drivers. The US has 7.3 deaths per billion km driven. This means if you drive 50km a day, every day, you are (essentially) guaranteed to die... after 75…

yet the leading cause of death in youths is automobile accidents: https://upload.wikimedia.org/wikipedia/commons/a/a5/Causes_o...

Well, we don't need self driving cars to fix that, just a way to increase the fatalities from cancer, heart disease, and Alzheimers in the young.

Re: After 6 months of working fine, Tesla software update drives at barriers again

#350

Earlier quoted context omitted.

> apparently change their handling and driving profile overnight at the whim of the software engineers at Tesla, without even telling the drivers OTA updates only happen after confirmed by the users. Where did you hear that it happens without user intervention?

You're right. The owner/driver has to approve the update, if I recall. But putting responsibility to review and understand release notes on the car's owner seems kind of absurd. And that's assuming that you have accurate and descriptive release notes, which was most certainly not the case for the described instance. In any case, clicking "update" is such a rote behavior for users on computers, phones, and now their T…

Disclosure seems like a red herring, if there is no real choice other than to accept the update. If I get an update to my car that says "this may cause your car to explode at random times", and I don't want to scrap it, the only thing I can do is look around and see if other people are ignoring the warning, and then rationalize that it won't happen to me.

You can't ever look at consent outside of the context of the best available alternative to agreeing to something.

Post reply on HN