Live data from Hacker News

Waymo robotaxi hits a child near an elementary school in Santa Monica

techcrunch.com

141–150 of 813 posts

Re: Waymo robotaxi hits a child near an elementary school in Santa Monica

#141

From the Waymo blog... > the pedestrian suddenly entered the roadway from behind a tall SUV, moving directly into our vehicle's path. Our technology immediately detected the individual as soon as they began to emerge from behind the stopped vehicle. The Waymo Driver braked hard, reducing speed from approximately 17 mph to under 6 mph before contact was made. > Following contact, the pedestrian stood up immediately, w…

[deleted]

Re: Waymo robotaxi hits a child near an elementary school in Santa Monica

#142
post #12

I'm curious as to what kind of control stack Waymo uses for their vehicles. Obviously their perception stack has to be based off of trained models, but I'm curious if their controllers have any formal guarantees under certain conditions, and if the child walking out was within that formal set of parameters (e.g. velocity, distance to obstacle) or if it violated that, making their control stack switch to some other "p…

With above-average human reflexes, the kid would have been hit at 14mph instead of 6mph.

About 5x more kinetic energy.

Re: Waymo robotaxi hits a child near an elementary school in Santa Monica

#143
post #45

Earlier quoted context omitted.

It depends on the situation, and we need more data/video. But if there are a bunch of children milling about an elementary school in a chaotic situation with lots of double parking, 17 mph is too fast, and the Waymo should have been driving more conservatively.

> But if there are a bunch of children milling about an elementary school in a chaotic situation with lots of double parking, 17 mph is too fast, and the Waymo should have been driving more conservatively. UK driving theory test has a part called Hazard Perception: not reacting on children milling around would be considered a fail. [0] https://www.safedrivingforlife.info/free-practice-tests/haza...

Many states in the US have the Basic Speed Law, e.g. California:

> No person shall drive a vehicle upon a highway at a speed greater than is reasonable or prudent having due regard for weather, visibility, the traffic on, and the surface and width of, the highway, and in no event at a speed which endangers the safety of persons or property.

The speed limit isn't supposed to be a carte blanche to drive at that speed no matter what; the basic speed law is supposed to "win." In practice, enforcement is a lot more clear cut at the posted speed limit and officers don't want to write tickets that are hard to argue in court.

Re: Waymo robotaxi hits a child near an elementary school in Santa Monica

#144

Earlier quoted context omitted.

Wait, is double parking allowed anywhere?

Pretty common at airports; of course, the `parking` only lasts a few minutes at most.

It’s common but almost always illegal based on the posted signage.

Re: Waymo robotaxi hits a child near an elementary school in Santa Monica

#145

Earlier quoted context omitted.

Yup. And to add > Waymo said in its blog post that its “peer-reviewed model” shows a “fully attentive human driver in this same situation would have made contact with the pedestrian at approximately 14 mph.” It's likely that a fully-attentive human driver would have done worse. With a distracted driver (a huge portion of human drivers) it could've been catastrophic.

I think my problem is that it reacted after seeing the child step out from behind the SUV. An excellent driver would have already seen that possible scenario and would have already slowed to 10 MPH or less to begin with. (It's how I taught my daughter's to drive "defensively"—look for "red flags" and be prepared for the worst-case scenario. SUV near a school and I cannot see behind it? Red flag—slow the fuck down.)

Aye, and to always look for feet under and by the front wheel of vehicles like that.

Stopped buses similarly, people get off the bus, whip around the front of them and straight into the streets, so many times I’ve spotted someone’s feet under the front before they come around and into the street.

Not to take away from Waymo here, agree with thread sentiment that they seem to have acted exemplary

Re: Waymo robotaxi hits a child near an elementary school in Santa Monica

#146

And before the argument "Self driving is acceptable so long as the accident/risk is lower than with human drivers" can I please get that out of the way: No it's not. Self driving needs to be orders of magnitude safer for us to acknowledge it. If they're merely as safe or slightly safer than humans we will never accept it. Becase humans have a "skin in the game". If you drive drunk, at least you're likely to be in the…

> Self driving needs to be orders of magnitude safer for us to acknowledge it

All data indicates that Waymo is ~10x safer so far.

"90% Fewer serious injury or worse crashes"

https://waymo.com/safety/impact/

Re: Waymo robotaxi hits a child near an elementary school in Santa Monica

#147
post #9

Earlier quoted context omitted.

For me, the policy question I want answered is if this was a human driver we would have a clear person to sue for liability and damages. For a computer, who is ultimately responsible in a situation where suing for compensation happens? Is it the company? An officer in the company? This creates a situation where a company can afford to bury litigants in costs to even sue, whereas a private driver would lean on their i…

Waymo hits you -> you seek relief from Waymo's insurance company. Waymo's insurance premium go up. Waymo can weather a LOT of that. Business is still good. Thus, poor financial feedback loop. No real skin in the game. John Smith hits you -> you seek relief from John's insurance company. John's insurance premium goes up. He can't afford that. Thus, effective financial feedback loop. Real skin in the game. NOW ... add…

>John Smith hits you -> you seek relief from John's insurance company. John's insurance premium goes up. He can't afford that. Thus, effective financial feedback loop. Real skin in the game.

Ah great, so there's a lower chance of that specific John Smith hitting me again in the future!

Re: Waymo robotaxi hits a child near an elementary school in Santa Monica

#148

From the Waymo blog... > the pedestrian suddenly entered the roadway from behind a tall SUV, moving directly into our vehicle's path. Our technology immediately detected the individual as soon as they began to emerge from behind the stopped vehicle. The Waymo Driver braked hard, reducing speed from approximately 17 mph to under 6 mph before contact was made. > Following contact, the pedestrian stood up immediately, w…

For me it would be interesting to know if 17 mi/h was a reasonable speed to be driving in this environment under these conditions to begin with. In my school zones that's already close to the maximum speed allowed. What was the weather, were there cars parked which would make a defensive driver slow down even more?

Re: Waymo robotaxi hits a child near an elementary school in Santa Monica

#149

Earlier quoted context omitted.

Exactly. That’s why I’ve always said the driving is a truly AGI requiring activity. It’s not just about sensors and speed limits and feedback loops. It’s about having a true understanding for everything that’s happening around you: Having an understanding for the density and make up of an obstacle that blew in front of you, because it was just a cardboard box. Seeing how it tumbles lightly through the wind, and formi…

How many human drivers do you think would pass the bar you're setting? IMO, the bar should be that the technology is a significant improvement over the average performance of human drivers (which I don't think is that hard), not necessarily perfect.

> How many human drivers do you think would pass the bar you're setting?

How many humans drivers would pass it, and what proportion of the time? Even the best drivers do not constantly maintain peak vigilance, because they are human.

> IMO, the bar should be that the technology is a significant improvement over the average performance of human drivers (which I don't think is that hard), not necessarily perfect.

In practice, this isn't reasonable, because "hey we're slightly better than a population that includes the drunks, the inattentive, and the infirm" is not going to win public trust. And, of course, a system that is barely better than average humans might worsen safety, if it ends up replacing driving by those who would normally drive especially safe.

I think "better than the average performance of a 75th or 90th percentile human driver" might be a good way to look at things.

It's going to be a weird thing, because odds are the distribution of accidents that do happen won't look much like human ones. It will have superhuman saves (like that scooter one), but it will also crash in situations that we can't really picture humans doing.

I'm reminded of airbags; even first generation airbags made things much safer overall, but they occasionally decapitated a short person or child in a 5MPH parking lot fender bender. This was hard for the public to stomach, and if it's your kid who is internally decapitated by the airbag in a small accident, I don't think you'll really accept "it's safer on average to have an airbag!"

Post reply on HN