Live data from Hacker News

Hawking: AI could end human race

bbc.com

81–90 of 118 posts

Re: Hawking: AI could end human race

#81

Earlier quoted context omitted.

He's saying that regardless of the hypothesized danger, until there is measurable, non sci-fi proof, it's all just fear mongering. Not that we shouldn't "give a fuck about anything."

You cannot have non sci-fi proof of future events, it will always be unmeasurable theories. So you can choose to wait and see, and maybe it will be too late or to hard to act when you have sufficient proof. Or you can choose to start thinking about it now, and see what we can do to to set up safeguards. And perhaps those safeguards will be useless, perhaps not. That's called prevention.

You are not making a cohesive argument. First you were arguing that OP was essentially saying we shouldn't "give a fuck about anything." Now you're arguing that we should "start thinking about it now." Those are two completely different points.

You can do research and testing without fear mongering.

Re: Hawking: AI could end human race

#82

To all those saying it is impossible: The point you are making about it being impossible is as moot as the one those that fear AI are making. From logical point of view, singularity (a moment when AI has modified itself to the point beyond our capacity of control or even understanding) seems possible. I don't see a way for us to tell what will happen when it hits. One needs to remember that AI itself may not be evil,…

How would an AI exactly exterminate humans? Are we talking about it physically murdering us or just making us so depressed as to our comparative lack of intelligence that we kill ourselves?

Like others suggested, there may be a point in its development where we think we contain it (in a lab, whatever) that is isolated by normal security standards.

And then at some point AI breaks all our digital defenses (because it evolved in a way we never expected) and proceeds to spread (through an Internet or other network which will be far more advanced than what we have now) wreaking havoc along its way. Isolated systems? Not a problem if we figure out a way to transport ourselves through some media that's never been used before (dust particles? or maybe plain old air?).

We can't protect ourselves from something we don't understand.

Sounds like a sci-fi plot but to me it has no evident problem that would make it impossible.

Re: Hawking: AI could end human race

#83

Earlier quoted context omitted.

I'm sure Hawking and Musk are smarter and more knowledgeable on the subject than either of us... That is not a reasonable argument. They have demonstrated nothing but a fear and postulation and we cannot accept authority as evidence. Thus is the nature of science.

Fear is a demonstration of non competency? So there can never be harmful technologies? If someone more knowledgeable than me on a subject fears it, well I think it's worth at least listening to him. Not dismissing his concerns arrogantly. And when those person are one of the greatest scientist and one of the greatest entrepreneur of our time, both with some kind of expertise in AI, well...

Fool, that's precisely anti science. Pics or it didn't happen.

If they want to fund or partake in research, dope sauce, if the wanna just talk, then they get dismissed.

Re: Hawking: AI could end human race

#84
Sorry for disturbing you with my previous comment. And my real questions are: Will a robot with AI be treated as a human baby? Who has the permission to generate AI? When are you allowed to destroy such robot? If you don't want AI to end human race, there should be two cautious choices: 1) Never invent AI. 2) Never treat AIs as humans and destroy them when they do not obey your order.

Re: Hawking: AI could end human race

#85

Earlier quoted context omitted.

How would an AI exactly exterminate humans? Are we talking about it physically murdering us or just making us so depressed as to our comparative lack of intelligence that we kill ourselves?

Like others suggested, there may be a point in its development where we think we contain it (in a lab, whatever) that is isolated by normal security standards. And then at some point AI breaks all our digital defenses (because it evolved in a way we never expected) and proceeds to spread (through an Internet or other network which will be far more advanced than what we have now) wreaking havoc along its way. Isolated…

So it relies on a not yet understood law of physics. I don't think it's in any way reasonable to fear or plan our actions around not yet discovered physical laws.

Re: Hawking: AI could end human race

#87

Earlier quoted context omitted.

You cannot have non sci-fi proof of future events, it will always be unmeasurable theories. So you can choose to wait and see, and maybe it will be too late or to hard to act when you have sufficient proof. Or you can choose to start thinking about it now, and see what we can do to to set up safeguards. And perhaps those safeguards will be useless, perhaps not. That's called prevention.

You are not making a cohesive argument. First you were arguing that OP was essentially saying we shouldn't "give a fuck about anything." Now you're arguing that we should "start thinking about it now." Those are two completely different points. You can do research and testing without fear mongering.

Thinking about something (more than during a HN argument), to me, is the opposite of not giving a fuck, so I am being very cohesive, thank you.

Re: Hawking: AI could end human race

#88

Earlier quoted context omitted.

Fear is a demonstration of non competency? So there can never be harmful technologies? If someone more knowledgeable than me on a subject fears it, well I think it's worth at least listening to him. Not dismissing his concerns arrogantly. And when those person are one of the greatest scientist and one of the greatest entrepreneur of our time, both with some kind of expertise in AI, well...

Fool, that's precisely anti science. Pics or it didn't happen. If they want to fund or partake in research, dope sauce, if the wanna just talk, then they get dismissed.

Thank you for the compliment.

Stephen Hawking partakes in research, with Intel, mostly on speech recognition, to help him being able to better express himself.

Elon Musk funds several startups in the field of advanced AI.

Re: Hawking: AI could end human race

#89
post #9
post #6

It's interesting how people so smart in one field can be so ignorant in others, to the point of not being aware of their own ignorance. While science fiction and hollywood really love the idea of this magical moment where AI is created and becomes self aware and destroys us all, real AI is so far away that these concerns are laughable. It's just like all those dummies worrying the LHC would destroy the earth. It's fe…

How do you know it's far away? If I have to side with you or Musk (extremely intelligent engineer with insider knowledge of advancements), I'm siding with Musk.

Extremely intelligent people also make mistakes. There are plenty of examples of very smart people believing very wrong ideas.

Re: Hawking: AI could end human race

#90

Earlier quoted context omitted.

Like others suggested, there may be a point in its development where we think we contain it (in a lab, whatever) that is isolated by normal security standards. And then at some point AI breaks all our digital defenses (because it evolved in a way we never expected) and proceeds to spread (through an Internet or other network which will be far more advanced than what we have now) wreaking havoc along its way. Isolated…

So it relies on a not yet understood law of physics. I don't think it's in any way reasonable to fear or plan our actions around not yet discovered physical laws.

It may rely on them or it may not, you never know. It may simply outsmart or trick humans, no unknown physics involved :)

It's not reasonable, I agree, it's flip-a-coin game. There's no point saying that it's gonna end bad, there exists one's opinion though that it's not worth the risk.

Mine is that it's fully worth the risk.

Post reply on HN