Live data from Hacker News

Tesla Autopilot Almost Steers Model 3 into Oncoming Train

thedrive.com

71–80 of 328 posts

Re: Tesla Autopilot Almost Steers Model 3 into Oncoming Train

#71

Why is the US allowing this beta testing of a feature that impacts safety to continue? There have to be at least dozens of documented cases of this being unsafe. Have regulators just given up or are they that incompetent?

> There have to be at least dozens of documented cases of this being unsafe.

The human in the loop seems to catch the mistake just fine? Doesn't seem to be even remotely close to an accident?

Re: Tesla Autopilot Almost Steers Model 3 into Oncoming Train

#72

Earlier quoted context omitted.

If I understand you correctly, you're arguing that having machines making mistakes maybe ok if it's statistically less likely to happen than humans?

I'm asking the question of how common it is. If I understand you correctly, self-driving should be banned if there's 1 error?

There’s a built in autoban feature, one head on collision with a train activates it.

Unfortunately it sucks for all the innocent people on the train.

Re: Tesla Autopilot Almost Steers Model 3 into Oncoming Train

#73

Why is the US allowing this beta testing of a feature that impacts safety to continue? There have to be at least dozens of documented cases of this being unsafe. Have regulators just given up or are they that incompetent?

Because it hasn't impacted safety, there have been no known accidents so far with over 100k users. It's also the driver's responsibility to disengage at first sign of trouble, just like as it is on a freeway with cruise control on any other car. The problem is many of these Youtubers try to push the system to test its limits, and wait until the last second to disengage, or let it do the wrong thing (for clicks? look at the "oh" face in the video thumbnail).

Now there is a good argument that as FSD gets better it actually gets less safe, because drivers stop paying attention if it rarely makes a mistake. I think you can battle this kind of attention fatigue by making simple driving L4, but require attention for unprotected lefts and other more risky moments. Of course they'd need to have that approved, but having millions of vehicles on the road they should quickly be able to prove which kinds of driving FSD can do well enough for L4. To be clear: at of right now there is no kind of driving it can do to that safety level.

Re: Tesla Autopilot Almost Steers Model 3 into Oncoming Train

#76
Unprotected left turns are one of the most dangerous situations in driving. I consider myself a competent driver, haven't been in an accident in over two decades, and I barely trust myself to make an unprotected left. I've heard that UPS (used to?) ban their drivers from making unprotected lefts. Not in a million years would I ever trust this maneuver to software. Humans screw it up all the time:

https://old.reddit.com/r/IdiotsInCars/comments/uks7c2/unprot...

(No accident, the driver just gets stuck when the light changes.)

Here's a recent video of a Tesla driver videoing his car making the same unprotected left multiple times:

https://www.youtube.com/watch?v=j0Kvsq9xB8c

Given how much supervision it requires, I don't see the advantage of letting the car do the driving here.

Re: Tesla Autopilot Almost Steers Model 3 into Oncoming Train

#77
Meanwhile Cruise just obtained permission to charge passengers for driverless rides in San Francisco [1]. Cruise has been cleared to charge for rides in vehicles that will have no other people in them besides the passengers. There will be no back-up human driver present to take control if something goes wrong.

Why is Tesla so far behind? Tesla is generating these autopilot mishap news on such a regular basis that it is giving the entire industry a bad name.

[1] https://www.npr.org/2022/06/03/1102922330/driverless-self-dr...

Re: Tesla Autopilot Almost Steers Model 3 into Oncoming Train

#78

Earlier quoted context omitted.

Oh man, they're not using lidar? I had no idea, that's crazy they're just putting cars on the road just cameras and AI. Jeez.

Elon thinks that because humans can do all this with two eyes his cars should be able to do it with just cameras. Literal truth.

I mean, what are eyes except constantly refocusing cameras with changeable fields of view, light intake, quick focus backed by a brain that can take action on what is seen even before you actually visualise it?

To Musk and his goblins, that's basically just cameras. But it's okay, people keep assuring me he's a great engineer.

Or a complete fucking sociopath that's lied his way to success but hey

Re: Tesla Autopilot Almost Steers Model 3 into Oncoming Train

#79

Earlier quoted context omitted.

If I understand you correctly, you're arguing that having machines making mistakes maybe ok if it's statistically less likely to happen than humans?

I'm asking the question of how common it is. If I understand you correctly, self-driving should be banned if there's 1 error?

It should be banned without the ability to know ahead of time it is trustworthy within it's intended operating envelope. Said operating envelope should be clearly, and unambiguously explicable to a lay person.

Neither of those conditions are the case. I'd appreciate it if people would stop trying to use statistics to gove an unproven system being tested with a fundamentally unsafe methodology with minimal experimental controls a free pass.

Re: Tesla Autopilot Almost Steers Model 3 into Oncoming Train

#80
Actually, that steering into the oncoming train is just one of several severe instances in that video:

* Almost driving right into a barrier because road is closed: https://youtu.be/yxX4tDkSc_g?t=426

* Choosing the wrong lane and getting confused: https://youtu.be/yxX4tDkSc_g?t=666

* Trying to run a red light, right into traffic: https://youtu.be/yxX4tDkSc_g?t=732

* Stopping in the middle of an intersection without reason: https://youtu.be/yxX4tDkSc_g?t=789

* Choosing the wrong lane for a left turn: https://youtu.be/yxX4tDkSc_g?t=805

* Constantly activating and deactivating the left turn-signal without reason (you can't even turn left there): https://youtu.be/yxX4tDkSc_g?t=902

* Unable to make a proper left turn, almost running into pedestrians: https://youtu.be/yxX4tDkSc_g?t=1033

All of this during maybe 30min of driving. Also, these are just the most severe instances, the Tesla just drives very awkwardly. It is changing lanes way too often (also on intersections) without rhyme or reason, and it weirdly creeps forward during red lights, getting very close to crossing traffic, for no reason at all.

All in all, this is an incredibly poor performance.

Post reply on HN