Live data from Hacker News

Risks of Artificial Intelligence

thinkingwires.com

11–20 of 69 posts

Re: Risks of Artificial Intelligence

#12
Decisions should be accountable. Ordinarily, humans make decisions, so you can hold them to account.

But who's accountable when a machine makes a choice? You can't blame the hardware. The software doesn't have much meaning before it is trained.

That leaves the training data. The data are just facts, so you only have a few routes to find the root cause of a decision:

* If a datum is actually false, you can correct it.

* Selection of data for the training set

* Input order

I don't know much about AI. Maybe someone who knows more can explain how to investigate a contentious decision?

Re: Risks of Artificial Intelligence

#13

Earlier quoted context omitted.

A fair question, but Terminator™ is germane to the subject matter.

No it is not. It is a movie made for entertainment. We are in reality. It really irks me how much debate and decision-making in technology is based on bias gained from mindless entertainment and not from anything based in reality. (I am not besmirching the good name of Terminator, that movie is a true classic)

I would continue this discussion, but I've gotten a ton of downvotes for both of my comments, so it seems people would rather not have this discussion continue :(

EDIT: Thank you whoever took pity and upvoted my previous comments. Everything I say is in good humor, I'm not trying to detract from the conversation about AI.

Re: Risks of Artificial Intelligence

#14

Earlier quoted context omitted.

I think the better question is: Should we really be taking real-life advice from cheesy action movies?

Star Trek gadgets become real for example. I don't see any impossible thing about building an IRL terminator. Maybe not with today's technology, but conceptually we already have most of the things, they are just slow, power hungry and inefficient now. You don't need a CS degree to guess that speed, power consumption and efficiency will improve over time.

The creation of goals - determining what things to do in pursuit of a higher goal - for example "kill John Conner" does not exist in AI now. You can do things in toy systems like mazes and atari, chess and go, but parsing the real world and deriving intentions from your understanding of it is a light year away. 300 years is a guess; no one has a clue any more than anyone has an idea about an interstellar drive.

Re: Risks of Artificial Intelligence

#15
"when asking to "make all humans happy", the ASI might decide that the safest and most efficient way of doing so is to drug everyone and to turn us all into numb but happy creatures"

If the AI is so dumb that it doesn't know that happiness means different things to different people, it will be too dumb to take over the world. And by the same token it will not be a Strong AI, just a weak AI given too much power.

Re: Risks of Artificial Intelligence

#16

Earlier quoted context omitted.

A fair question, but Terminator™ is germane to the subject matter.

No it is not. It is a movie made for entertainment. We are in reality. It really irks me how much debate and decision-making in technology is based on bias gained from mindless entertainment and not from anything based in reality. (I am not besmirching the good name of Terminator, that movie is a true classic)

Wether you like it or not it has become a part of the conversation. It is part of the culture and we can't just ignore it simple because it is fiction. Your dismissal of it is to many as irksome as it's inclusion is to you. Perhaps calm down and recognize that it is partially tongue in cheek but also not something we can simply ignore.

Re: Risks of Artificial Intelligence

#17
I see one danger; it's incredibly easy to manipulate humans at large scale (see history). That's our vulnerability and machines will exploit it.

We see our world through thoughts and ideas evolved by us. How can we trust that we stay pure in a world where information comes from machines? Are we part machine then too?

Re: Risks of Artificial Intelligence

#19

Earlier quoted context omitted.

No it is not. It is a movie made for entertainment. We are in reality. It really irks me how much debate and decision-making in technology is based on bias gained from mindless entertainment and not from anything based in reality. (I am not besmirching the good name of Terminator, that movie is a true classic)

Wether you like it or not it has become a part of the conversation. It is part of the culture and we can't just ignore it simple because it is fiction. Your dismissal of it is to many as irksome as it's inclusion is to you. Perhaps calm down and recognize that it is partially tongue in cheek but also not something we can simply ignore.

I am calm, but the fact that science fiction entertainment and smart people in real life think AI is a threat is a sign we may have gotten a little carried away in taking notes from entertainment.

If someone would like to provide some evidence of some form of computer intelligence acting maliciously, this would be a different discussion, but the fact is that sort of thing has no basis in reality and so should have no influence on the way we behave and debate in reality.

Re: Risks of Artificial Intelligence

#20

The public doesn't take this stuff seriously enough. Did we not learn the lesson about rogue AI from Terminator™?

Whether or not you're joking, I think the real problem with using Terminator as an example is that it's overly optimistic. The story is roughly:

1) US military builds up arsenal of autonomous killing machines and nuclear missiles

2) US military connects all of these to the Internet

3) US military creates a powerful AI which takes control of this arsenal (whether it was put in charge or hacks in seems to vary across the movies)

4) AI "becomes self-aware"

5) AI tries to wipe out humanity

Almost all of the discussion around this focuses on step 4, either by asking if/when an AI will "become self aware", or by trying to explain why that's meaningless and/or unlikely.

Meanwhile I think the real dangers are steps 1 and 2, which seem to be proceeding without much public outcry.

Yes, there are rogue AGI scenarios which end badly for everyone; but there are also issues of hacking (state-sponsored or otherwise), and/or terrorism (homegrown or otherwise).

It may have made political sense to build up ever-larger nuclear arsenals during the cold war, but these days it seems like that's just increasing the risk of accident or misuse.

Post reply on HN