Live data from Hacker News

For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

bloomberg.com

41–50 of 190 posts

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#41

Question for people here: Is it justifiable to accept these flaws in the short-term if it results in a car that has a lower-error rate than human drivers in the medium/long-term?

This comparison gets me the most. People bringing up human error rate vs machine error rate. They’re not comparable at all. And it will be evident when you have majority autonomous cars on the road. Human errors are more or less RANDOM. Machine errors are NOT.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#42

Question for people here: Is it justifiable to accept these flaws in the short-term if it results in a car that has a lower-error rate than human drivers in the medium/long-term?

There is no need for us to accept the flaws in the short term. People can keep developing this tech without us mass adopting it first.

I considered this before posting, but I think that human disengagements are an important supervisory signal for the model. You can’t hire enough safety drivers to scale this process and releasing it is the fastest way to get there. Simulations are not going to get you all the way because you can’t simulate the real world perfectly. Do you have any thoughts on how to develop this without releasing it?

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#43
post #41

Question for people here: Is it justifiable to accept these flaws in the short-term if it results in a car that has a lower-error rate than human drivers in the medium/long-term?

This comparison gets me the most. People bringing up human error rate vs machine error rate. They’re not comparable at all. And it will be evident when you have majority autonomous cars on the road. Human errors are more or less RANDOM. Machine errors are NOT.

also, human failure modes are better understood, and can be better anticipated by e.g. you can still have a somewhat predictive mental model of how a swerving drunk drive might behave.

We don't have a good frame of reference for how machines might behave with their failures, which means that accidents could be worse than they would be otherwise.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#44
post #41

Question for people here: Is it justifiable to accept these flaws in the short-term if it results in a car that has a lower-error rate than human drivers in the medium/long-term?

This comparison gets me the most. People bringing up human error rate vs machine error rate. They’re not comparable at all. And it will be evident when you have majority autonomous cars on the road. Human errors are more or less RANDOM. Machine errors are NOT.

1. I’d challenge the premise that human errors are random. There are a ton of patterns that cause accidents including intoxication, low visibility conditions and tiredness. I haven’t done a statistical analysis but I’d hazard a guess that only a minority of human accidents are truly random. 2. Why does the randomness matter if the error rate is lower? Certainly if the errors are predictable, they can be discovered and fixed or avoided?

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#45
post #41

Question for people here: Is it justifiable to accept these flaws in the short-term if it results in a car that has a lower-error rate than human drivers in the medium/long-term?

This comparison gets me the most. People bringing up human error rate vs machine error rate. They’re not comparable at all. And it will be evident when you have majority autonomous cars on the road. Human errors are more or less RANDOM. Machine errors are NOT.

What do you mean with that, and why does the error type/"randomness" matter?

If I can reduce the error rate by 90%, but the remaining 10% are "random" (whatever that means), is that worse than not reducing the error rate?

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#46

Question for people here: Is it justifiable to accept these flaws in the short-term if it results in a car that has a lower-error rate than human drivers in the medium/long-term?

The same argument would justifies human medical experiments, and we know they actually work, and result in faster access to improved drugs and vaccines.

Unlike autopilot which could still be crappy after 10 years

Yet we have made them illegal after some rather nasty precedents. Seems like hsitory repeats itself

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#47

Question for people here: Is it justifiable to accept these flaws in the short-term if it results in a car that has a lower-error rate than human drivers in the medium/long-term?

It's about risk trade off. If it's 2x better than humans is it worth it? 10x? 100x?

36,096 deaths in 2019 in U.S. ~1.3 million worldwide (I couldn't find injury statistics this morning)

If the flaw is found before someone dies from it I'm not concerned. If 1 person dies instead of 10 I'm all for it. (I'd take 2x better than humans any day)

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#48
post #43
post #41

Earlier quoted context omitted.

This comparison gets me the most. People bringing up human error rate vs machine error rate. They’re not comparable at all. And it will be evident when you have majority autonomous cars on the road. Human errors are more or less RANDOM. Machine errors are NOT.

also, human failure modes are better understood, and can be better anticipated by e.g. you can still have a somewhat predictive mental model of how a swerving drunk drive might behave. We don't have a good frame of reference for how machines might behave with their failures, which means that accidents could be worse than they would be otherwise.

The severity of the accident is an interesting point. Though it intuitively feels like there are ways for software to mitigate the severity of an accident when it realizes it is about to crash than a human who might be asleep, intoxicated or otherwise have a slower reaction time.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#49
post #4

Yes, would you trust a car with an error rate of 0.001%?

Tesla's drives on a highway, encounters a difficult situation, turns off autopilot, and voala, the error is now counted against the human!

It does not even work in difficult situations and busy chaotic streets, and that's when all the crashes happen.

It's like the statistics that says sharks only attack near beaches - that where 99.99% of people are!

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#50

Earlier quoted context omitted.

There is no need for us to accept the flaws in the short term. People can keep developing this tech without us mass adopting it first.

I considered this before posting, but I think that human disengagements are an important supervisory signal for the model. You can’t hire enough safety drivers to scale this process and releasing it is the fastest way to get there. Simulations are not going to get you all the way because you can’t simulate the real world perfectly. Do you have any thoughts on how to develop this without releasing it?

> You can’t hire enough safety drivers to scale this process and releasing it is the fastest way to get there.

I am sorry but I sincerely hope you are never made responsible for the release of anything remotely safety-critical.

Please re-read what you wrote. You are saying that because a business does not have enough money/resources to scale a process in real-world conditions that the solution is to release something and verifying in the real-world, on a public road, risking real human lifes?

If you don't have enough money to test it then you don't have an actual product/business.

Post reply on HN