Live data from Hacker News

There is a blind spot in AI research

nature.com

31–40 of 55 posts

Re: There is a blind spot in AI research

#31

Key quote: “People worry that computers will get too smart and take over the world, but the real problem is that they’re too stupid and they’ve already taken over the world.” -- Pedro Domingos, in The Master Algorithm (2015)

It's an entertaining quote, I laughed, but I think everyone who works in AI already knows this. It's not a blind spot.

That it's not a blind spot among "everyone who works in AI" does not make it any less a blind spot.

Re: There is a blind spot in AI research

#32
With or without AI we already have issues with too much automation/assistance, and it get bad when automation they are failing/lack of maintaining.

Basically if you can drive a manual car, it is easy to drive an automatic one, but the opposite is not true.

Old GPS and even new one got 15% of the time the address wrong when I was a mover. Not only GPS failed, but what do you do when you have no usable maps?

Well, we have fired the people doing the maps, they are hardly updated at the pace mayors and real estates promoters are changing the territory, if you have an awesome GPS with no updated maps your GPS is useless, no?

We are forgetting to do the heavy underlying costly maintaining of maps, directions, forming drivers to read signs figuring GPS made them obsolete. Now we have to maintain: maps, satellite, computers and to live with people unable to use a map and a compass that are distracted when they drive by potentially wrong information and to dumb to read the sign saying there are entering a one way street in counter sense relying on their GPS.

Then too, the automation in Airbus/tesla and Boeing have proven to be less valuable then pilots' experience when computers fail due to false négative (frozen Pitot probes) or false positive (sun blinding cameras). I think civil and military records about accidents are a nice source of information about "right level of automation".

The problem is keeping up to date workers requires constant, heavy practice without too much automation. And human time nowadays is expensive.

That is one of the reason France (at the opposite of Japan) kept automation in nuclear plant rudimentary. Because when a system is critical, you really prefer human that can handle stuff at 99.999% than a computer that do great 100% of the time if and only if its sensors do works or nothing too catastrophic happens (flood, tsunamin, earthquake)

The problem is industry wants to spare on costly formations and educations (not the one from the university, I mean the one that is useful) but knowledge you have not yet crafted because of change of circumstances (I will be delighted to see how self driving car are behaving in massive congestion with dead locks) will be hard to program if we lose the common sense of doing the stuff by ourselves. How do you correct a machine misfunctioning to do something you have forgotten to do correctly yourself? You may even ignore when it will fail. Not because of it, but because of your lack of referential.

Re: There is a blind spot in AI research

#33
I wish HN discouraged clickbait titles, even when the article itself uses that title. One solution is to append the answer to the original title, separated by a "|", as used by: https://www.reddit.com/r/savedyouaclick/

For example:

There is a blind spot in AI research | Auto­nomous systems are already ubiquitous, but there are no agreed methods to assess their effects

If it's interesting, I'll still click.

Re: There is a blind spot in AI research

#35
I'm not too sure how practical the suggested "social-systems analysis" approach is. It is summarized as:

"A practical and broadly applicable social-systems analysis thinks through all the possible effects of AI systems on all parties."

which seems incredibly difficult to do completely. Hopefully the authors will further describe their approach in future publications.

Also, somewhat of a nitpick, but the article states:

"The company has also proposed introducing a ‘red button’ into its AI systems that researchers could press should the system seem to be getting out of control."

in reference to Google, but cites a paper which discusses mitigating the effects of interrupting reinforcement learning [0]. The paper makes a passing reference to a "big red button" as this is a common method for interrupting physically situated agents, but that is certainly not the contribution or focus of the work.

[0] https://intelligence.org/files/Interruptibility.pdf

Re: There is a blind spot in AI research

#37
This is vastly overblown. People already vastlh distrust algorithms. Psychologists have studied it and called it "algorithmic bias". That when given a choice between computer and human, even when the computer makes much better predictions, people distrust it.

In almost every domain where there is data and a simple prediction task, even really crude statistical methods outperform "experts". This has been known for decades. Yet in almost every domain algorithms are resisted. Because people distrust them so much, or fear losing their jobs, or all of the above.

But humans are vastly more biased. Unattractive people get twice as long sentences. People heavily discriminate based on political denomination. Not to mention race or gender. Judges give way harsher sentences when they are hungry. Interviews negatively correlate with job performance.

Humans are The Worst. Anywhere they can be replaced with an algorithm, they should be.

The referenced propublica result has been criticized here: https://www.chrisstucchio.com/blog/2016/propublica_is_lying.... "almost statistically significant"

Re: There is a blind spot in AI research

#38

This is vastly overblown. People already vastlh distrust algorithms. Psychologists have studied it and called it "algorithmic bias". That when given a choice between computer and human, even when the computer makes much better predictions, people distrust it. In almost every domain where there is data and a simple prediction task, even really crude statistical methods outperform "experts". This has been known for dec…

Agree, we need more algorithms replacing people.

Re: There is a blind spot in AI research

#39

I wish HN discouraged clickbait titles, even when the article itself uses that title. One solution is to append the answer to the original title, separated by a "|", as used by: https://www.reddit.com/r/savedyouaclick/ For example: There is a blind spot in AI research | Auto­nomous systems are already ubiquitous, but there are no agreed methods to assess their effects If it's interesting, I'll still click .

> I wish HN discouraged clickbait titles, even when the article itself uses that title

It actually does discourage that, I remember seeing a post from dang saying so.

Re: There is a blind spot in AI research

#40

This is vastly overblown. People already vastlh distrust algorithms. Psychologists have studied it and called it "algorithmic bias". That when given a choice between computer and human, even when the computer makes much better predictions, people distrust it. In almost every domain where there is data and a simple prediction task, even really crude statistical methods outperform "experts". This has been known for dec…

Release the algorithms!

In fairness though, it sounds like the point you and others are often making is this. Humans are now considered dumb, bias and unreliable. So we need to invest in some kind of external policing system (AI) to run our world for us and make sure we're doing it right. Basically establish reliance on something external to ourselves?

This is sad because it sounds like we're losing faith in ourselves to evolve for the better and hope the machines can do a better job at self-improvement ?

I'm generally curious about your point of view, sometimes I'm confused with the enthusiasm people have about this aspect of AI? Is it a form of distrust and dislike of society that makes us want to put faith in robots? A kind of adult angst?

I worry because we could be barking up the wrong tree if this is the case.

Post reply on HN