Live data from Hacker News

Normalized crash data shows Autopilot is much less safe than Tesla claims

twitter.com

411–420 of 462 posts

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#411
post #94
post #22

I have felt since day 1 that "autopilot is better than the average driver!" is the most misleading fact/statistic in the industry. The "average driver" involved in an accident includes drunk drivers, road ragers, habitual speeders, teenagers, people driving in bad conditions (rain, snow), people driving without sleep and several other risky groups that most people buying Teslas aren't part of. To be worth it, the car…

I don't disagree with your broader statement about autopilot's safety relative to other drivers, but... >The "average driver" involved in an accident includes drunk drivers, road ragers, habitual speeders, teenagers, people driving in bad conditions (rain, snow), people driving without sleep and several other risky groups that most people buying Teslas aren't part of. ... what ? Tesla owners absolutely can be habitua…

>I really don't understand why anyone would assume that Tesla owners are less likely to have those traits than non-Tesla owners.

I think it was a comparison to Autopilot rather than Tesla owners. Robot drives can't be drunk, don't need sleep etc.

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#412
post #401

Earlier quoted context omitted.

Because in the context of regulations, they don't claim it to be self-driving.

Which I don't understand. Marketing is part of what makes the product. You can't simply promise stuff on your website and then put something else in the fine print. If you market the thing as (almost) self-driving, then the fine-print doesn't really matter. It is about customer expectations. Most regulated products require post market surveillance. You have to actively monitor the market and how consumers behave. If…

I've yet to hear anyone who bought a Tesla say they didn't realise what they are getting. Searching HN there are 600 linked articles on Tesla self driving. It's not really a secret.

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#413

Earlier quoted context omitted.

Actually, seems like you want a train

I'll answer that with another piece of prognostication: good highway self-driving will cause massive disruption to the airline industry. Would you rather do this for a business trip to a 400-500 mile away city: - fixed time to depart (and fixed for leaving your destination!) - have to book ticket weeks in advance for a reasonable flight - no flexiblity if plans change - pack a small bag - transit to an airport (parki…

Lol you describes me. I could fly my work routes but I take the car exactly because every reason you stated

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#414

How is it that Tesla (and other companies developing self-driving capabilities) are allowed to deploy their products in the real world? We make people take a test to get a drivers license -- why don't we have requirements for self-driving systems? We require that cars pass routine mechanical inspections -- why isn't the software controlling these cars regulated?

This is the point that bothers me the most. Everyone is so fixated on the things they can see and talk about (i.e. regulate). The complex mountain of software running on these cars is the entire bucket of liability. How do you mandate software quality? I don't think testing alone is enough if you seriously care about safety. Any test can be gamed as tesla has aptly demonstrated so far.

Dunno - what Musk says that you can judge it on whether it's safer or not compared to humans seems ok to me. There's no practical way really to go through the mountain of code and conclude much. But maybe the judging should be done by someone independent rather than Tesla judging themselves.

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#415

How is it that Tesla (and other companies developing self-driving capabilities) are allowed to deploy their products in the real world? We make people take a test to get a drivers license -- why don't we have requirements for self-driving systems? We require that cars pass routine mechanical inspections -- why isn't the software controlling these cars regulated?

Regulators are asleep at the wheel.

Maybe regulators don't want to over regulate? It's not like the current situation of a million road deaths a year is great.

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#416
post #339

Earlier quoted context omitted.

So to summarize: - Freeways account for 93% of distance travelled with Autopilot - Freeways account for 28% of the distance travelled by regular drivers. - "vehicles on non-freeways crashed 2.01 times more often per mile" a quick back of the envelop calculation suggests merely driving on the freeway lowers accidents per mile by ~40%, which accounts for most of the difference between Autopilot and regular drivers.

Again the old tricks, from "How To Lie With Statistics." I get you a perfect Sample around age, income, sex, nationality, times of day and others. Prove to you 98% of people in this Town love Romantic Comedies. The only thing I am not telling you, is that I am running the Inquiry at the exit atrium door of a Romantic Comedy movie...

I doubt you'd be able to get much over 50%, given how often the audience there is couples on dates :P

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#417

Underlying study is here. [1] Full disclosure, I co-wrote the piece for The Daily Beast [2] that originally suggested that Tesla's methodology was seriously flawed. I am not a Tesla-hater though — I just thought it was odd that the company was playing quite so fast and loose with their safety claims. 1: https://engrxiv.org/preprint/view/1973/3986 2: https://www.thedailybeast.com/how-tesla-and-elon-musk-exagge...

So to summarize: - Freeways account for 93% of distance travelled with Autopilot - Freeways account for 28% of the distance travelled by regular drivers. - "vehicles on non-freeways crashed 2.01 times more often per mile" a quick back of the envelop calculation suggests merely driving on the freeway lowers accidents per mile by ~40%, which accounts for most of the difference between Autopilot and regular drivers.

> more often

This is what matters. If/when it becomes less often, the case will be made (i.e. driverless doesn't have to be perfect to be better).

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#418
post #22

I have felt since day 1 that "autopilot is better than the average driver!" is the most misleading fact/statistic in the industry. The "average driver" involved in an accident includes drunk drivers, road ragers, habitual speeders, teenagers, people driving in bad conditions (rain, snow), people driving without sleep and several other risky groups that most people buying Teslas aren't part of. To be worth it, the car…

I've been using taxis in my city for like 50 times, and I've never even felt remotely in danger, except when I was in a Tesla taxi. The driver were well composed, calm and seemed rational, but we've had 5 (!) near crash situations in a 15 minute drive, simply because the car can accelerate into spots opening up in moderately dense traffic so quickly that nobody can expect it.

The car enables a completely novel driving style which people need getting used to.

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#419
post #44

I was just watching this video of a Tesla trying and miserably failing to drive itself through the streets of Boston: https://twitter.com/TaylorOgan/status/1488555256162172928 A number of these near-crashes seem to be pretty odd errors (a couple of times it just decided to drive on the wrong side of the street?) -- albeit ones that one _could_ see drivers unfamiliar with the area making. If a human driver started dri…

In those interventions it's not 100% clear the car would have generated an accident. They get very "close" so the driver intervenes. And of course this is the safe thing to do. But highly sensitive AI driving should be able to come much closer to crashing than the average human, without issue. Perhaps it's the drivers that will need to adapt. Is Tesla accounting for this fear factor already?

Re: Normalized crash data shows Autopilot is much less safe than Tesla claims

#420

Earlier quoted context omitted.

Perhaps the downvotes are because most people would be apprehensive about putting their life in the hands of an "average" safe driver that's built from software? I probably wouldn't allow any other average safe human to drive me, if the alternative of me driving myself is available.

You never take ubers on the grounds of safety? Because that is, on average, an average human. Either way, I'm not too impressed. I wouldn't purchase Autopilot personally for similar safety reasons. But let's not twist the stats to suggest they're actually much worse than they are.

It's not actually. If you look at the stats professional drivers crash far less than the average driver per mile. More experienced, not drunk etc.
Post reply on HN