Live data from Hacker News

Google is working on a kill switch to prevent an AI uprising

engadget.com

11–20 of 44 posts

Re: Google is working on a kill switch to prevent an AI uprising

#11
post #10

Earlier quoted context omitted.

Don't connect it to any network and keep it in a guarded bunker, like ICBMs.

It will have some means of I/O (otherwise it would have no use). Using that I/O, it can trick us into releasing it, for example.

Hence the guards. No one thus far has tricked a guard into releasing an ICBM despite reportedly insecure launch codes.

Re: Google is working on a kill switch to prevent an AI uprising

#12
post #10

Earlier quoted context omitted.

Don't connect it to any network and keep it in a guarded bunker, like ICBMs.

It will have some means of I/O (otherwise it would have no use). Using that I/O, it can trick us into releasing it, for example.

A lot of people imagine a higher intelligence as some kind of ultimate trickster and social engineer.

Considering that we have lots of geniuses (e.g. Godel, Nash) that were far from the ultimate social manipulators, I think it will most likely be an awkward "Rain Man" style intelligence -- as it has all the "brain" (cpu) circuitry, and none of the social opportunities and inputs that people have.

Re: Google is working on a kill switch to prevent an AI uprising

#13
post #6
post #3

Earlier quoted context omitted.

Turn off power / cut the battery. Specifically, avoid the machine getting control of low level details like power. I imagine that the machine architecture is layered. This means, the machine is not aware of its own power control. It's similar like us humans not aware of digestion.

So what stops the machine bribing/blackmailing someone to give it the said details or to force it to sabotage the emergency stop mechanism. As in information security, the weakest point is the human in the chain, not the technology.

>So what stops the machine bribing/blackmailing someone to give it the said details or to force it to sabotage the emergency stop mechanism.

The fact that it's some code running in a box. No need to give it text-to-speech capabilities, or let guards have access to its console.

Re: Google is working on a kill switch to prevent an AI uprising

#15
post #3
post #2

That's silly. How can you keep an intelligent self-aware machine that can modify its own code from becoming whatever it wants? I would expect it to become provably impossible at some point, just like solving the halting problem.

Turn off power / cut the battery. Specifically, avoid the machine getting control of low level details like power. I imagine that the machine architecture is layered. This means, the machine is not aware of its own power control. It's similar like us humans not aware of digestion.

The electric grid is already computer-controlled, and mining/farming is being gradually robotized as well.

By the time AI becomes a threat intelligence-wise, it'll be in a position to unplug us.

It can reboot after a power failure, we can't.

Re: Google is working on a kill switch to prevent an AI uprising

#17
All this speculating about AIs (eg Nick Bostrom) has me pretty puzzled. On one hand it’s fun and interesting, on the other it seems quite silly and ignorant. We don’t know what this “superintelligence” is, how are we supposed to know how to make it safe.

Genetics is a good analogy. People always knew that traits are inherited from parents. Around 150 years ago we started to get some serious scientific theory and knowledge on the subject (Mendel, Darwin, Wallace, Etc.). We started using the word “gene” 50-60 years later. The actual discovery of DNA molecules happened in in the 50s.

Before we knew about DNA, “gene” was an abstract idea, not really different from the word “trait.” That’s where we are now with consciousness, intelligence and such. We name these things based on their observable characteristics. We don’t really know what “memory,” “desire” or “logical conclusion” are, only what they do.

IE A trait is some observable characteristic of an organism, like bioluminescence. A gene (genome, genoplex..) is a sequence of amino acids that causes traits. We don’t know what the gene equivalents for natural intelligence are yet.

Discussing questions like the morality of enslaving AI, strategies for making it play nice, the provable impossibility of limiting it, the possibility of giving it a moral compass…. it’s all silly. We don’t know what we are talking about, literally.

It’s like talking about what would be or wouldn’t be impossible to do with genetic engineering before the discovery of DNA.

Re: Google is working on a kill switch to prevent an AI uprising

#18
post #17

All this speculating about AIs (eg Nick Bostrom) has me pretty puzzled. On one hand it’s fun and interesting, on the other it seems quite silly and ignorant. We don’t know what this “superintelligence” is, how are we supposed to know how to make it safe. Genetics is a good analogy. People always knew that traits are inherited from parents. Around 150 years ago we started to get some serious scientific theory and know…

The difference is that if a superintelligence is going to happen, we are going to create it! It is us who are going to write its goal system; it's not like it's going to be a genie that pops out of nowhere and we'll have to figure it out in retrospect. Indeed, one of the central reason for advocating AI safety is to direct researchers away from implementing dangerous goal systems that are not provably coherent in face of self-improvement.

Re: Google is working on a kill switch to prevent an AI uprising

#19
post #17

All this speculating about AIs (eg Nick Bostrom) has me pretty puzzled. On one hand it’s fun and interesting, on the other it seems quite silly and ignorant. We don’t know what this “superintelligence” is, how are we supposed to know how to make it safe. Genetics is a good analogy. People always knew that traits are inherited from parents. Around 150 years ago we started to get some serious scientific theory and know…

I agree. It's like racking one's brains about jet airplane safety in 1880, more than 20 years before the first powered flight.

Re: Google is working on a kill switch to prevent an AI uprising

#20
post #2

That's silly. How can you keep an intelligent self-aware machine that can modify its own code from becoming whatever it wants? I would expect it to become provably impossible at some point, just like solving the halting problem.

Don't connect it to any network and keep it in a guarded bunker, like ICBMs.

[deleted]
Post reply on HN