Live data from Hacker News

Tesla confirms “Autopilot” crash in Montana

ktvq.com

241–250 of 530 posts

Re: Tesla confirms “Autopilot” crash in Montana

#241

"It's a winding road going through a canyon, with no shoulder," Shope told CNNMoney. The driver told Shope the car was in Autopilot mode, traveling between 55 and 60 mph" Wow, really? This is not the Autosteer's fault, it's pure negligence

Also, the car told the driver to take back control of the vehicle, which the driver ignored. People with no respect for the danger of driving are going to get hurt, with or without driver assist technology.

Then it should gradually and slowly come to a stop.

Re: Tesla confirms “Autopilot” crash in Montana

#242
post #194
post #164

Earlier quoted context omitted.

Such a value system would be a nightmarish thing so I hope that it doesn't exist yet. Just imagine your car calculating that it should let you die in order to save a group of school children... except that the school children were in fact a bunch of sheep that the system mis-identified. The danger of AI isn't in paperclip optimizers (at least for now), it's in humans over-relying on machine learning systems.

I think such a value system is fine in as much as it preserves the safety of the driver. I'd like my car to make value judgements about what's safer - braking and colliding with an object or swerving to avoid it. I'd rather it brakes and collides with a child than swerve into oncoming traffic, but I'd rather it swerved into oncoming traffic to avoid a truck that would otherwise T-bone me. As long as the system only a…

It's fine for you until you step outside the car.

Re: Tesla confirms “Autopilot” crash in Montana

#243

With three accidents on "autopilot" in a short period, the defects in Tesla's design are becoming clear. 1. Tesla's "hands on wheel" enforcement is much weaker than their competitors. BMW, Volvo, and Mercedes have similar systems, but after a few seconds of hands-off-wheel, the vehicle will start to slow. Tesla allows minutes of hands-off time; one customer reports driving 50 miles without touching the wheel. Tesla i…

> It takes seconds, not milliseconds, for the driver to recover situational awareness and take over.

The really depressing thing is that this is first-year material for one of the most popular tertiary courses around: psychology. It is simply gobsmacking to think that Tesla thinks a human can retarget their attention so quickly. It's the kind of thing you'd give to first-year students and say "what is wrong with this situation", it's so obvious.

Re: Tesla confirms “Autopilot” crash in Montana

#245
post #24

Earlier quoted context omitted.

I'm sure it.can detect whether or not there are vehicles behind it.

As long as it's not too bright out and the object isn't highly reflective and there's no glare and it's not too high and... Given that the sensors can't detect a semi completely blocking the road, I'm reluctant to make any statements about what the Tesla can and can't detect.

It can detect a car immediately behind it with the ultrasonic sensors. There is a reverse camera, but it's not hooked up to the autopilot system (just used for showing on the display).

So, no, it can't really detect cars more than a few feet behind it.

Re: Tesla confirms “Autopilot” crash in Montana

#246
post #229

Earlier quoted context omitted.

Why do you think the accident rate is lower among luxury cars as compared to more common vehicles? I would suspect the opposite. My hypothesis is that the people who seek out and buy cars that go 0 to 60 in 3.2 seconds probably drive faster and more aggressively than average. They therefore are more likely to have an accident.

Luxury cars do tend to do pretty well among late model cars in terms of fatality rates--haven't seen rates for accidents overall. But the biggest correlation is probably that bigger cars are safer and smaller cars less so: http://www.cbsnews.com/news/report-lists-cars-with-highest-a... The fatality rates are probably also notably better on late model cars relative to clunkers because of safety features.

But this is overanalyzing, if we use only the "1 fatality in 130 million miles" stat. That 1 fatality was a car driving under a truck at speed and losing its entire top half.

I don't think more expensive cars are less likely to have that kind of accident, nor would it be less fatal.

Re: Tesla confirms “Autopilot” crash in Montana

#247
post #12
post #5

> "As road conditions became increasingly uncertain, the vehicle again alerted the driver to put his hands on the wheel," said Tesla. "He did not do so and shortly thereafter the vehicle collided with a post on the edge of the roadway." If the autopilot's confidence was dropping that rapidly, why did it not slow the vehicle? If it hits zero confidence it should halt completely until the driver restarts the car in man…

I think you'll find suddenly braking in the middle of the road poses its own dangers.

[deleted]

Re: Tesla confirms “Autopilot” crash in Montana

#248
post #29

I wrote this on a previously buried thread: Naming their system "autopilot" goes beyond the marketing dept overstepping and into the territory of irresponsibility. The "average" definition of autopilot per Wikipedia is "autopilot is a system used. . . WITHOUT CONSTANT 'HANDS-ON' control by a human operator being required." And yet Tesla's disclaimer states: "Tesla requires drivers to remain engaged and aware when Aut…

If it's a good enough name for airplanes, it's a good enough names for cars. Both require users to be ready to take control at any moment.

> If it's a good enough name for airplanes, it's a good enough names for cars

* The real autopilot doesn't require hands-on-the-yoke while it is engaged, but 'autopilot' does.

* Airplanes don't have to deal with complex traffic conditions requiring interaction with other airplanes

* Airplanes do not smash into lane barriers/trees if they veer a few feet off the expected course

* "Taking control" on an airplane could safely take tens of seconds, but for a car, that is far too long.

So no, autopilot isn't good enough for cars. Cars need something much better.

Re: Tesla confirms “Autopilot” crash in Montana

#249

Earlier quoted context omitted.

Well sadly the first casualties was a man that made 3 millions view on YouTube with a video called "Autopilot saves Model S" months before his fatal accident... http://youtu.be/9I5rraWJq6E At that time I don't recall that Tesla made any statement about how dangerous it was to deliberately push the limit of the system to entertains viewers. This might have contributed to make him overconfident about autopilot. RIP

> At that time I don't recall that Tesla made any statement about how dangerous it was to deliberately push the limit of the system to entertains viewers. Yeah who knows. I think Musk retweeted his video. Hindsight is 20/20. Tesla can still move forward and learn from this.

That's going to hurt in the lawsuit, isn't it?

Re: Tesla confirms “Autopilot” crash in Montana

#250

With three accidents on "autopilot" in a short period, the defects in Tesla's design are becoming clear. 1. Tesla's "hands on wheel" enforcement is much weaker than their competitors. BMW, Volvo, and Mercedes have similar systems, but after a few seconds of hands-off-wheel, the vehicle will start to slow. Tesla allows minutes of hands-off time; one customer reports driving 50 miles without touching the wheel. Tesla i…

Once again Tesla have made the discussion about the driver. They have put an auto-control system out in the wild that steers the car into hard obstacles at high speed. Beeps to warn the driver at some stage in the preceding interval do not make this control systems failure any more acceptable. It still misjudged situation as acceptable to continue and it still drove into obstacles. Those are significant failures and…

> Those are significant failures and a blanket statement of responsibility going to the driver isn't going to cut it.

That will be the communication pattern for the next two decades; we better get used to it.

Post reply on HN