Live data from Hacker News

U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

reuters.com

481–490 of 507 posts

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#481

Earlier quoted context omitted.

Well for starters, they’re taking out the radars that other cars rely on to accomplish this.

In other parts of this thread, people are suggesting that these crashes are the radar's fault and deploying their vision-only system will fix the problem.

As the sibling post says, that’s ridiculous at face value. All the radar is check for collisions because that’s how a radar works...is there a non-intuitive answer here???

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#482
post #395

Earlier quoted context omitted.

Tesla does not offer a vehicle that does not require human drivers (not even momentarily). Tesla's autopilot and FSD systems are both SAE Level 2, which means the human is still in operation of the vehicle at all times . All of Tesla's driving assistance technologies require a human to monitor operation of the vehicle and intervene if necessary. The fact that they have given anyone an impression otherwise is problema…

> The fact that they have given anyone an impression otherwise is problematic. Good grief. This meme will not die. The car literally tells you to keep your hands on the wheel every time you engage autopilot, yells at you if you don't, will lock you out of the system as punishment if you don't comply, and if you really seem disabled will bring the car to a stop and turn the hazards on. It simply will not operate witho…

Here's #1 out of your zero drivers ;)

"Tesla driver slept as car was going over 80 mph on Autopilot, Wisconsin officials say"

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#483

Earlier quoted context omitted.

During the 3 years I’ve owned it there are 2 places where lines are wonky and I know to take over. I have not yet struggled to stay alert when it drives me, and it has driven better than I would have - so it certainly is an improvement over me driving 100% of the time. It does not have road rage and it does not enjoy the feeling of speeding, like I do when I drive, nor does it feel like driving is a competition, like…

> Would you buy a machine that is not your servant? I mean... that's an odd thing for someone to say who has bought a vehicle with over-the-air firmware updates.

Very true! And I’m typing this on an iPhone…

I wish I could hack but car, but also wouldn’t trust others if they did

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#484
post #17
post #3

This is why I believe the approach of incremental improvement towards full self driving is fundamentally flawed. These advanced driver assist tools are good enough to lull users into a false sense of security. No amount of "but our terms and conditions say you need to always pay attention!" will overcome human nature building that trust and dependence.

I disagree. One feature my car has is to pull me back into the lane when I veer out of it (Subaru's lane keep assist). That is still incremental improvement towards "full self driving". I agree, however, that Tesla's Autopilot is not functional enough, and any tool designed to allow humans to remove their hands from the wheel should not require their immediate attention in any way.

I think that's actually a step towards a local maximum that makes us less likely to achieve actual FSD. The safer we can make AI-guided driving where a person is still in control, the higher the bar becomes for a solo AI to be significantly safer than the alternatives.

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#485

Earlier quoted context omitted.

What's the... Difference?

One is a permanent property of our nature the other a choice.

No, one is a fact and the other is a consequence

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#486
post #283

Earlier quoted context omitted.

> the issue boils down to their use of the term "Autopilot" for a product that is not Autpilot It is literally an autopilot. Just like an autopilot on an airplane, it keeps you stable and in a certain flight corridor. There's virtually no difference except for Tesla's Autopilot's need to deal with curved trajectories.

> There's virtually no difference except for Tesla's Autopilot's need to deal with curved trajectories. Well, and it actively avoids collisions with other vehicles (most of the time). Airplane (and boat) autopilots don't do that. "But you're using the word autopilot wrong!"

Well, they still need to avoid the collisions more reliably, apparently. Once they do it perfectly reliably I will add it into the list of the things it does differently from an airplane autopilot. ;)

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#487
post #428

Earlier quoted context omitted.

I feel like part of the problem with the kind of autopilot crashes you describe here is how inexplicable they are to humans. Whilst humans can be dangerous drivers, the incidents they cause generally have a narrative sequence of events that are comprehensible to us -- for instance, driver was distracted, or visibility was poor. But when a supposedly 'all-seeing always watching' autopilot drives straight into a large…

Another aspect of unpredictability is that drivers are expected to be alert and vigilant while using ADAS features, but I get the impression that Tesla's implementation sometimes does things that are completely unexpected. Sometimes you might have to react immediately to something you didn't see coming, because you didn't expect the car to suddenly try to steer into a concrete pillar or something. It's one thing to h…

I think the problem we're seeing here is that Tesla's autopilot system is on the cusp of a fully automated driving experience and that feels good enough to the driver. Yet it's not quite good enough, as we can see from the mistakes it has made.

Honestly, I see this as a necessary transition pain towards fully automated vehicles. No matter how you slice it there's going to be periods where fully automated driving systems aren't quite there yet but are good enough 97% of the time that human drivers let their guard down. It's going to take some sacrifices to get to fully autonomous driving.

The good news is that even with these accidents self-driving features are a bazillion times safer than human drivers. It sure seems like the occasional vehicle collision into stationary objects is going to throw a great big wrench into self-driving safety statistics but it isn't even a rounding error compared to the sheer number of accidents caused by human drivers.

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#488

Right. As I've pointed out previously, Tesla seems to be unable to detect sizable stationary obstacles that are partly blocking a lane, especially if they don't look like the rear end of a car. In addition to emergency vehicles, Teslas on autopilot have plowed into freeway barriers and a street sweeper. That's the usual situation for first responders, who usually try to block as little of the road as possible but oft…

Elon keeps warning the world about the impending hyperintelligent AI that will retool human economies, politics, and religions, yet year after year his cobbled-together AI fails at basic object detection.

AI is a bogus term. It was well-discredited in the 1980s and has gone through an ill-deserved rehabilitation. Deep neural nets are a step forward for some tasks like vision, but are still just scratching the surface of what really goes on in our brains when sense-making from visual data.

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#489

Right. As I've pointed out previously, Tesla seems to be unable to detect sizable stationary obstacles that are partly blocking a lane, especially if they don't look like the rear end of a car. In addition to emergency vehicles, Teslas on autopilot have plowed into freeway barriers and a street sweeper. That's the usual situation for first responders, who usually try to block as little of the road as possible but oft…

Elon keeps warning the world about the impending hyperintelligent AI that will retool human economies, politics, and religions, yet year after year his cobbled-together AI fails at basic object detection.

I'm split over this. On one hand The AI is so incompetent that it could never take over the world and enslave humanity. On the other, its so incompetent that it winds up killing humans anyway. lose-lose.

Re: U.S. opens probe into Tesla’s Autopilot over emergency vehicle crashes

#490
post #442

Earlier quoted context omitted.

My problem with those crashes is that they are entirely explicable : The car is blind to stationary objects in the road. (My best guess at the logic is they assume that "anything stationary cannot possibly be in the road, right?") To me, that blindness is simply unacceptable. If there is anything in the road, whether identified or not, it should automatically be flagged as a hazard. That flag should only be removed i…

I’m not sure about newer models without radar, but the older ones explicitly discard stationary returns on their radar. As I understand it, without elevation data it can’t know if it’s a bridge you’ll pass under, a soda can in the road, or a stopped car - so just ignore it all. Of course the vision system is supposed to compensate for this, and it performs poorly on objects it doesn’t see often, like emergency vehicl…

why should it matter how often it sees something? Or even if it's something the car has never seen before? All it should care about is whether there is an obstacle, not what the obstacle is. Whether it's an emergency vehicle, a sofa, a boulder, a canoe, a table saw, or a dolphin, you don't want to hit it!
Post reply on HN