Superintelligence cannot be contained: Lessons from Computability Theory
1–10 of 227 posts
Re: Superintelligence cannot be contained: Lessons from Computability Theory
#2By the abstract, it seems that the very same superintelligence we'd want to contain would itself be "something theoretically (and practically) infeasible."
No?
Re: Superintelligence cannot be contained: Lessons from Computability Theory
#3By the abstract, it seems that the very same superintelligence we'd want to contain would itself be "something theoretically (and practically) infeasible." No?
Yes.
The
> on input potentially as complex as the state of the world
bit gives it away.
Re: Superintelligence cannot be contained: Lessons from Computability Theory
#4> Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world
Rest easy folks. This is purely theoretical.
Re: Superintelligence cannot be contained: Lessons from Computability Theory
#5This is fantastic. Are these original illustrations? So well done.
Re: Superintelligence cannot be contained: Lessons from Computability Theory
#6> Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world Rest easy folks. This is purely theoretical.
Until it isn't and we are faced yet again with a much worse pandemic like situation.
Re: Superintelligence cannot be contained: Lessons from Computability Theory
#7> Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world Rest easy folks. This is purely theoretical.
Until it isn't and we are faced yet again with a much worse pandemic like situation.
Except that actual pandemics are demonstrable, predictable, and based in known science, yes?
Re: Superintelligence cannot be contained: Lessons from Computability Theory
#8> Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world Rest easy folks. This is purely theoretical.
"Purely theoretical" is too weak. "Physically impossible" is better.
AI Safety guys really like using the physically impossible to advance their arguments. It's bizarre! Pure fantasy isn't something worth reacting to.
Re: Superintelligence cannot be contained: Lessons from Computability Theory
#9By the abstract, it seems that the very same superintelligence we'd want to contain would itself be "something theoretically (and practically) infeasible." No?
Yes. The > on input potentially as complex as the state of the world bit gives it away.
Heh, that's how I took it too, glad I wasn't alone. :-)
Re: Superintelligence cannot be contained: Lessons from Computability Theory
#10Sorry for the snark, but Douglas Adams also demonstrated this: the earth as a super-intelligent computing device ended up getting a piece of itself onto a passing space ship, avoiding complete destruction.
I just like the idea of thinking about all of earth, including what we'd consider having or not having life, as a single super intelligence. Of course you could scale up to include the solar system, galaxy or even universe.
But this doesn't require us to be a simulation. This could be both a computing device and physical, so long as the engineer behind it existed in greater dimensions.