Live data from Hacker News

Paperclip Machine

howacarworks.com

1–10 of 11 posts

Re: Paperclip Machine

#7
I was so sure this would be about the paperclip maximizer:

"The paperclip maximizer is the canonical thought experiment showing how an artificial general intelligence, even one designed competently and without malice, could ultimately destroy humanity."

http://wiki.lesswrong.com/wiki/Paperclip_maximizer

beware!

Re: Paperclip Machine

#8

I was so sure this would be about the paperclip maximizer: "The paperclip maximizer is the canonical thought experiment showing how an artificial general intelligence, even one designed competently and without malice, could ultimately destroy humanity." http://wiki.lesswrong.com/wiki/Paperclip_maximizer beware!

Yeah, but the paper-clip maximizer theory is pretty awfully flawed. It rests on the idea that a generally human-level of intelligence necessarily leads to a super-human explosion of intelligence.

This is clearly not the case.

Re: Paperclip Machine

#9

I was so sure this would be about the paperclip maximizer: "The paperclip maximizer is the canonical thought experiment showing how an artificial general intelligence, even one designed competently and without malice, could ultimately destroy humanity." http://wiki.lesswrong.com/wiki/Paperclip_maximizer beware!

Yeah, but the paper-clip maximizer theory is pretty awfully flawed. It rests on the idea that a generally human-level of intelligence necessarily leads to a super-human explosion of intelligence. This is clearly not the case.

>It rests on the idea that a generally human-level of intelligence necessarily leads to a super-human explosion of intelligence.

Why must it be necessary? If there's a large chance, that's still a problem. Besides, the claim is generally that a human-created intelligence is unlikely to be in the same range as humans (because there's no reason to think that the human range on the spectrum is unique), so if it's not dumber, then it's most likely going to significantly smarter. There's also the point that if you have a human-level AI, simply throwing more computing power at it makes it strictly faster than humans.

See http://intelligenceexplosion.com/en/2011/plenty-of-room-abov... and http://www.nickbostrom.com/superintelligence.html for some examples of these arguments.

Post reply on HN