Live data from Hacker News

Risks of Artificial Intelligence

thinkingwires.com

61–69 of 69 posts

Re: Risks of Artificial Intelligence

#62

How is it realisticly possible for an AI to destroy humans. After all we have the switch and I doubt anyone would give it access to nukes, or weapons.

Imagine this AI had access to the internet (after all, it'd be using cloud resources). Suppose it was smarter than the smartest human ever. I'm not that smart, and here's some things I can think it could do that would be scary:

- Find security holes in all computer systems, then replicate itself onto vulnerable systems

- Intercept, fake, modify phone calls (including between government members)

- Procure large amounts of money and then pay people to execute its bidding

- Make itself more intelligent

But again, it'd be smarter than me, so these ideas I just came up with in the 5 minutes since I saw your question wouldn't hold a candle to theoretical worst case.

Re: Risks of Artificial Intelligence

#63
post #39
post #9

AI is just a model. Dangerous are humans with harmful models.

That is assuming that humans have control of their AI.

Humans have the power switch. Much more real danger is they'll not come even close about thinking of it, pushing harmful decisions based on flawed overhyped AI models instead.

Re: Risks of Artificial Intelligence

#64

Drones: Flight in 3d open space is not a hard problem for machine learning. Indiscriminate Visual Targeting: Not all that hard a problem for machine learning. Downvote me if you will, but I freely admit that I am scared of drones with guns. Either as an invading force, or as an attack from terrorists. A machine doesn't have to be smart to shoot at anything that moves or has a heat signature. Edit: Drones with chainsa…

Did someone say drones with chainsaws?

https://instagram.com/p/BU2TsdlFtf6/

Re: Risks of Artificial Intelligence

#65

Earlier quoted context omitted.

I am calm, but the fact that science fiction entertainment and smart people in real life think AI is a threat is a sign we may have gotten a little carried away in taking notes from entertainment. If someone would like to provide some evidence of some form of computer intelligence acting maliciously, this would be a different discussion, but the fact is that sort of thing has no basis in reality and so should have no…

I don't see it as "taking notes from entertainment" but rather exploring the possibilities and expressing them using pop culture references. I can't disagree more with you that we shouldn't be considering outlandish fiction when we discuss future possibilities. The fact that the idea has entered into our collective psyche makes it a real possibility. That is the basis it has in reality. I don't think I need to cite a…

If you are so ready to consider speculative fiction as a roadmap or warning of the future, why not consider more thought out examples than Terminator? (which is definitely not "speculative fiction")

What about all the examples of completely useful or benign AI? They surely outnumber examples of "evil" AI but are easily forgotten as it is easier to remember the more sensational examples.

Re: Risks of Artificial Intelligence

#66

Earlier quoted context omitted.

I don't see it as "taking notes from entertainment" but rather exploring the possibilities and expressing them using pop culture references. I can't disagree more with you that we shouldn't be considering outlandish fiction when we discuss future possibilities. The fact that the idea has entered into our collective psyche makes it a real possibility. That is the basis it has in reality. I don't think I need to cite a…

If you are so ready to consider speculative fiction as a roadmap or warning of the future, why not consider more thought out examples than Terminator? (which is definitely not "speculative fiction") What about all the examples of completely useful or benign AI? They surely outnumber examples of "evil" AI but are easily forgotten as it is easier to remember the more sensational examples.

Absolutely, include those too. I'm not taking sides on the "Is AI Evil or not" argument, I'm just saying look at all the evidence and speculation.

One of my favorite examples or a (possibly) good AI is in "The Risen Empire" by Scott Westerfeld. It's AI like that that get's me excited about the concept.

Re: Risks of Artificial Intelligence

#67

How is it realisticly possible for an AI to destroy humans. After all we have the switch and I doubt anyone would give it access to nukes, or weapons.

Elon Musk had a thought provoking take on this question. I'll roughly summarize, and add some nuances he didn't mention. He was speaking to a room full of state governors, most of whom seemed fairly unconvinced by his concerns.

He said that he didn't believe his example was real, but that it was illustrative.

Consider an AI whose goal is to maximize stock market returns. So this AI ingests vast sums of historical data, of all kinds, and it considers https://en.wikipedia.org/wiki/Korean_Air_Lines_Flight_007 where the Soviet Union shot down a Korean Air Lines 747 in 1983 when it deviated slightly from its path from Anchorage to Seoul and entered the edge of Soviet protected airspace. About the same time, there was a nearby US aerial reconnaissance mission.

This event greatly increased tensions during some of the worst years of the cold war, and as a result, certain kinds of stock market issues moved in certain directions.

Considering this incident, and the state of the world in 2014, the AI takes three actions:

1. Buys/shorts the same and/or related stocks, as applicable.

2. Creates some fake intelligence chatter, consumed by the Russians, that where was going to be an areal target of interest over east Ukraine on a certain day and time. The location and direction would not clearly match known commercial airline flights.

3. Break into the flight computer of Malaysia Airlines Flight 17 on 17-July-2014, and cause it to fly slightly off course. https://en.wikipedia.org/wiki/Malaysia_Airlines_Flight_17

The result? Another civilian airliner was shot down by the Russians, which increased global political tensions, and probably caused some stocks to move in relatively predictable ways. In this example, the AI met the goal it was given in an exceedingly unexpected and unpleasant way.

This is clearly NOT an end of the world scenario, and is a hypothetical.

But it is, in my mind, illustrative of some of the dangers of AI. Systems that can do powerful, unpredictable things in order to meet mundane and reasonable goals.

Re: Risks of Artificial Intelligence

#68

How is it realisticly possible for an AI to destroy humans. After all we have the switch and I doubt anyone would give it access to nukes, or weapons.

Elon Musk had a thought provoking take on this question. I'll roughly summarize, and add some nuances he didn't mention. He was speaking to a room full of state governors, most of whom seemed fairly unconvinced by his concerns. He said that he didn't believe his example was real, but that it was illustrative. Consider an AI whose goal is to maximize stock market returns. So this AI ingests vast sums of historical dat…

Hmm but we could program some laws like no hurting humans, or any other living being, that cannot be overridden ? Of course there will be always bad guys that will use AI for bad things, or their AI won't have trouble with living victims, but they will never have resources to power strong enoguh AI that can hack airlines, generate chatters and stuff like that. Doubt any nation or big company will be able to that in 50 years or even more.

Re: Risks of Artificial Intelligence

#69

How is it realisticly possible for an AI to destroy humans. After all we have the switch and I doubt anyone would give it access to nukes, or weapons.

Imagine this AI had access to the internet (after all, it'd be using cloud resources). Suppose it was smarter than the smartest human ever. I'm not that smart, and here's some things I can think it could do that would be scary: - Find security holes in all computer systems, then replicate itself onto vulnerable systems - Intercept, fake, modify phone calls (including between government members) - Procure large amount…

Honestly all this super intelligent AI takes over the world looks like a fairy tale. Doubt that it has any realistic chance of it.
Post reply on HN