Live data from Hacker News

Waymo self-driving car crashed when driver fell asleep and triggered manual mode

qz.com

31–40 of 124 posts

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#31
post #20

That's tricky. So you need to be able to take control of the car quickly in an emergency, but at the same time you want the human pseudodriver to be free to be distracted or drowsy, and so in a state where they could accidentally hit this button.

No. Waymo wants their test drivers to be attentive and alert, so that when the cars are ready, the passengers don't have to be.

They should really have two test drivers there, though.

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#32

Poor UX, poor safety controls. At this stage in the game, these prototype vehicles should absolutely detect whether or not their operators are paying attention, since they’re part of the safety system of the vehicle. Also, did they not learn from Uber’s fatal crash? A sole operator in these vehicles is a terrible idea. One person to monitor road conditions and one person to operate any computer equipment should be th…

these prototype vehicles should absolutely detect whether or not their operators are paying attention The car did warn the driver with two audio signals, what more should it do?

Not crash?

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#33
post #16
post #9

It's so sad how these companies are spending billions on developing this technology and then still cheap out on the test drivers by having them drive solo and for too long hours (and presumably at minimum wage)

Waymo's vehicle operators make $20 bucks an hour. The driver was about an hour into his shift when he dozed off.

Which highlights the issue that if there isn't some level of engagement required (or some level of fear/stress that it might be required) your mind/body can reach a restful enough state to fall asleep; in this case of course too, the test driver may not have taken care of themselves properly, had proper sleep, or many other possibilities - which I wonder if we'll get a truthful account of (whether due to Waymo and/or the driver not being straightforward).

It's an interesting edge case that you might not think of, or thinking the odds might be "one in a million" and not design for it; I wonder how many driving hours etc have occurred so far (and other statistical analysis to breakdown different contexts) before this "one in a million" event occurred.

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#34
post #9

It's so sad how these companies are spending billions on developing this technology and then still cheap out on the test drivers by having them drive solo and for too long hours (and presumably at minimum wage)

What wage are they paying? What’s so sad is when people make assumptions about things about which they clearly don’t have a grasp of the facts.

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#35
post #16

Earlier quoted context omitted.

Waymo's vehicle operators make $20 bucks an hour. The driver was about an hour into his shift when he dozed off.

The lack of requirement for driver input is what causes the operator to drift off or fall asleep. The same reason they put test/dummy positive weapon images that aren't physically present in the xray image stream at security checkpoints; to keep the operator alert. If you have a human overseer in the seat, you want to find ways to continue to keep them engaged even if it isn't necessary for the vehicle's autonomy.

Well the driver did provide input, he touched the gas pedal, which disengaged the autonomous system and put the vehicle in manual mode, and that's presumably what you want to have happen.

When it's time to disengage the vehicle you don't want to be fighting for control with the computer, manual override needs to be on a hair trigger in case the computer makes a sudden error. Unfortunately so long as there's a human in the loop, the propensity for human error is going to be there. I honestly don't know what Waymo could do to prevent this, multiple bells and whistles went off.

Waymo takes this stuff very seriously, they absolutely do not want to have to face the music should one of their vehicles get into an at-fault accident or suffer some other kind of catastrophic failure.

I just did a Google News search for "asleep at the wheel", and in the last week a few people have been killed, a few more hospitalized, and the more minor incidents don't even get reported. Waymo sincerely wants to solve this, but there's an awkward no-mans land between no autonomy and fully autonomous where Vigilance Decrement[1] is an issue.

Fortunately this was a minor accident. Waymo's test fleet reportedly covers 25,000 miles a day, and in regular day to day driving minor accidents happen about once every 160,000 miles. So if incidents like this are happening once a week for Waymo, that's about par for the course.

https://en.wikipedia.org/wiki/Vigilance_(psychology)#Vigilan...

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#36

Earlier quoted context omitted.

these prototype vehicles should absolutely detect whether or not their operators are paying attention The car did warn the driver with two audio signals, what more should it do?

Not crash?

It was in manual mode. Should it forcibly take away control from the user that gave it a direct command, because it "thinks" they're not paying attention?

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#37
post #19

That tester detected a serious bug in the whole concept, inadvertently risking his life during testing. He should've been promoted.

This is definitely the correct response - what is the role of testing if not to uncover flaws in both design and implementation?

It does make me wonder what screening for test drivers they use.

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#38
post #17

Poor UX, poor safety controls. At this stage in the game, these prototype vehicles should absolutely detect whether or not their operators are paying attention, since they’re part of the safety system of the vehicle. Also, did they not learn from Uber’s fatal crash? A sole operator in these vehicles is a terrible idea. One person to monitor road conditions and one person to operate any computer equipment should be th…

What's the point if you have to pay attention? I'm being serious when I ask. I question weather people can safely use these vehicles in these modes where they're supposed to not interact ... but pay close attention at the same time. I think it is going to have to be full autonomy, or not at all.

There's a difference between usage while testing and usage in the final product. While they're testing the system, they should probably have two operators paying attention.

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#39

Poor UX, poor safety controls. At this stage in the game, these prototype vehicles should absolutely detect whether or not their operators are paying attention, since they’re part of the safety system of the vehicle. Also, did they not learn from Uber’s fatal crash? A sole operator in these vehicles is a terrible idea. One person to monitor road conditions and one person to operate any computer equipment should be th…

Uber’s fatal crash was caused by a crazy, suicidal person who literally stepped in front of the car. A human driver couldn’t have avoided her.

Re: Waymo self-driving car crashed when driver fell asleep and triggered manual mode

#40

That tester detected a serious bug in the whole concept, inadvertently risking his life during testing. He should've been promoted.

Agreed, but lets not get ahead of ourselves.

The statement is the "Driver no longer works for waymo" not that "they were fired for the incident.".

That feels somewhat deliberate choice of words to me.

Post reply on HN