Live data from Hacker News

For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

bloomberg.com

11–20 of 190 posts

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#11
What will happen if a deep-learning bug is found in Tesla autopilot where it misclassifies a fire truck for a bridge?

Will they ground all the Tesla cars remotely? Or disable autopilot remotely? Until they have gathered new training data and updated the software?

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#12
post #8

Earlier quoted context omitted.

Average humans have a higher error rate.

If you classify an image 30 times per second, then 0.001% is quite a large error rate.

Don't forget - the error might be reproduce-able. As in, it will error rarely, but at that one obstacle, with that one light config, it will error repeatedly and constantly.

AI related car accidents and deaths will have special places and dates, were they will repeat annually.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#13
post #7

And at the same time, the UK government is looking at reversing the GDPR review right for automated decisions: Article 22 guarantees that people can seek a human review of an algorithmic decision, such as an online decision to award a loan, or a recruitment aptitude test that uses algorithms to automatically filter candidates. In May, a government task force set up to look for deregulatory dividends from Brexit, led…

I advise companies on GDPR compliance, and art 22 is usually the least of their concerns. Why not offer a right to human review, if your algorithm is producing "legal or similarly significant effects"? If you're not 100% convinced in the accuracy and fairness of your automated system (two entirely separate GDPR rules), you can avoid issues down the line by offering individuals the ability to flag a dodgy decision and have a human look into it.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#14
post #8

Earlier quoted context omitted.

Average humans have a higher error rate.

If you classify an image 30 times per second, then 0.001% is quite a large error rate.

You said car, not image classifier.

If errors in any subsystem surface out to the car, well then okay. But it's not unlikely that the overall system would deal with an error in the image classifier.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#15
post #11

What will happen if a deep-learning bug is found in Tesla autopilot where it misclassifies a fire truck for a bridge? Will they ground all the Tesla cars remotely? Or disable autopilot remotely? Until they have gathered new training data and updated the software?

To add context. In Aviation, if they do find a bug in the software running an airplane's engine they do ground planes until they know more about impact and mitigation.

Not saying cars should do the same, just that it's not absurd to consider it.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#16
post #11

What will happen if a deep-learning bug is found in Tesla autopilot where it misclassifies a fire truck for a bridge? Will they ground all the Tesla cars remotely? Or disable autopilot remotely? Until they have gathered new training data and updated the software?

This has already been happening but self driving enthusiasts just keep thinking it is great. And regulators have done very little and otherwise smart people like Sandy Munro get extremely mad at what little regulators have hinted at. It is wild times.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#17
post #4

Yes, would you trust a car with an error rate of 0.001%?

Average humans have a higher error rate.

For me the question is how high is the error rate for a non drunk non sleepy non elderly non reckless human, since that is what my car would replace.

in my 20s you would need to bring the reckless back in.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#18
post #7

And at the same time, the UK government is looking at reversing the GDPR review right for automated decisions: Article 22 guarantees that people can seek a human review of an algorithmic decision, such as an online decision to award a loan, or a recruitment aptitude test that uses algorithms to automatically filter candidates. In May, a government task force set up to look for deregulatory dividends from Brexit, led…

These people are such chumps. Automated hellscape for thee, but not for me.

Oh they are not chumps. They know exactly what they're doing.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#19
post #15
post #11

What will happen if a deep-learning bug is found in Tesla autopilot where it misclassifies a fire truck for a bridge? Will they ground all the Tesla cars remotely? Or disable autopilot remotely? Until they have gathered new training data and updated the software?

To add context. In Aviation, if they do find a bug in the software running an airplane's engine they do ground planes until they know more about impact and mitigation. Not saying cars should do the same, just that it's not absurd to consider it.

Well, to be honest something like Tesla's Autopilot would never have been certified in Aerospace anyway. And yes, the question of what authorities would do in such a case is a valid one. It seems like authorities are struggling with functions like that, would it be simply hardware, e.g. faulty airbag sensors, recalls would have been already be issued.

Re: For Tesla, Facebook and Others, AI’s Flaws Are Getting Harder to Ignore

#20
post #7

And at the same time, the UK government is looking at reversing the GDPR review right for automated decisions: Article 22 guarantees that people can seek a human review of an algorithmic decision, such as an online decision to award a loan, or a recruitment aptitude test that uses algorithms to automatically filter candidates. In May, a government task force set up to look for deregulatory dividends from Brexit, led…

Is this another one of those GDPR articles that has no teeth? I cannot imagine how Google can keep running it’s spam filters, Facebook it’s automated bans, and Twitter its algorithmic feed, while abiding by this.
Post reply on HN