What a bizarre logical leap this early paragraph makes to try to explain why AI is beyond the capabilities of mere humans: "AI can be thought of as a search problem over an effectively infinite, high-dimensional landscape of possible programs. Nature solved this search problem by brute force, effectively performing a huge computation involving trillions of evolving agents of varying information processing capability…
"You might as well argue that since heavier-than-air-flight is a search problem over an effectively infinite, high-dimensional landscape of possible machines - and that since it took evolution billions of years to produce birds, we have little chance of stumbling upon a working design for a wing." Tired analogies between AI and flight are dead-ends. Until we have identified AI-side components of the analogy that corr…
Why human intelligence and AI will co-evolve
41–50 of 112 posts
Re: Why human intelligence and AI will co-evolve
#42Earlier quoted context omitted.
I think the objection isn't that those people didn't make huge and transformative contributions to the field. Rather, it is the tone set by the use of the worshippy word "genius", which has a murky, and totally relative definition, and the phrase "unusual cognitive ability", which implies that their abilities uniquely set these people apart from others who we don't worship in the same way. Uncounted numbers people ha…
Some people run faster than others, some people think better. This is not worship, merely the celebration of the best intellectual performers.
Re: Why human intelligence and AI will co-evolve
#43What a bizarre logical leap this early paragraph makes to try to explain why AI is beyond the capabilities of mere humans: "AI can be thought of as a search problem over an effectively infinite, high-dimensional landscape of possible programs. Nature solved this search problem by brute force, effectively performing a huge computation involving trillions of evolving agents of varying information processing capability…
"You might as well argue that since heavier-than-air-flight is a search problem over an effectively infinite, high-dimensional landscape of possible machines - and that since it took evolution billions of years to produce birds, we have little chance of stumbling upon a working design for a wing." Tired analogies between AI and flight are dead-ends. Until we have identified AI-side components of the analogy that corr…
Re: Why human intelligence and AI will co-evolve
#44Earlier quoted context omitted.
Sub-200 IQ men guessing what a 1000+ IQ man would do :).
It's probably safe to say he'd get bullied, but what do I know :).
Re: Why human intelligence and AI will co-evolve
#45Re: Why human intelligence and AI will co-evolve
#46Why do people think they can build anything worthy of the name "AI" by just fucking around with neural networks instead of by specifying exactly what sort of models and exactly what sort of inference constitute "intelligence" in the first place? It's like trying to build an airplane by studying hang-gliders instead of aerodynamics.
Doesn't this go back to the second paragraph of the article?
Re: Why human intelligence and AI will co-evolve
#47[deleted]
Re: Why human intelligence and AI will co-evolve
#48What a bizarre logical leap this early paragraph makes to try to explain why AI is beyond the capabilities of mere humans: "AI can be thought of as a search problem over an effectively infinite, high-dimensional landscape of possible programs. Nature solved this search problem by brute force, effectively performing a huge computation involving trillions of evolving agents of varying information processing capability…
Huh? He's not arguing that "AI is beyond the capabilities of mere humans". (Where did you get that from?) He's arguing that it's a hard problem, that the presence of lots of brains can lead people to mistakenly conclude it's easy, and that it will be easier with smarter humans. His argument would have worked just as well concerning heavier-than-air-flight, meaning that just because we see birds everywhere doesn't mea…
"Today, we need geniuses like von Neumann and Turing more than ever before. That’s because we may already be running into the genetic limits of intelligence.... AI research also pushes even very bright humans to their limits.... The detailed inner workings of a complex machine intelligence (or of a biological brain) may turn out to be incomprehensible to our human minds—or at least the human minds of today". (emphasis mine)
The entire thesis seems to be we will need artificial cognitive enhancements to be able to comprehend AI sufficiently to create it. It really sounds like he thinks we are too dumb to figure this out, that we are just scrabbling around in the dark trying solutions at random.
Re: Why human intelligence and AI will co-evolve
#49> Cognitive engineering, via direct edits to embryonic human DNA, will eventually produce individuals who are well beyond all historical figures in cognitive ability. Now that would be truly foolhardy. Blindly augmenting intelligence before cognitive moral reasoning is completely understood would be a recipe for incredibly dangerous psychopaths. At least with AI, you don't have a system that has been fine-tuned by eo…
Re: Why human intelligence and AI will co-evolve
#50That is such a weird estimate. Once AI reaches human ability, it will take a few hours-days at most to improve itself to become superhuman. And then it will rapidly approach singularity in a few hours more. Only a severe limitation of resources or a nuke will stop it at that point. It can probably figure out a way around these issues.