Live data from Hacker News

Superintelligence: The Idea That Eats Smart People

idlewords.com

11–20 of 607 posts

Re: Superintelligence: The Idea That Eats Smart People

#11
post #4

This article explicitly endorses argument ad hominem: "These people are wearing funny robes and beads, they live in a remote compound, and they speak in unison in a really creepy way. Even though their arguments are irrefutable, everything in your experience tells you you're dealing with a cult. Of course, they have a brilliant argument for why you should ignore those instincts, but that's the inside view talking. Th…

Er, that wasn't inventing theories about time travel, just about time.

Re: Superintelligence: The Idea That Eats Smart People

#12
'In particular, there's no physical law that puts a cap on intelligence at the level of human beings.'

Maybe not, but there are definitely very physical laws governing everything else, that a superintelligent being's ambitions would run into.

A superintelligent being isn't going to be able to build a superliminal reactionless drive if the laws of the universe say it isn't possible.

More relevant, a superintelligent being isn't going to be able to enslave us all with robots if the laws of chemistry don't permit a quantum leap in battery chemistry.

Re: Superintelligence: The Idea That Eats Smart People

#13

I did read the article through, but made up my mind that the author is presenting a flawed argument when I saw how quickly he skimmed through his base premises, not really giving them much in terms of fair thought. In particular, I don't see how he can so blithely assume so easily that there is no quantum effect in the brain structure. I feel there's some degree of arrogance there, as we have not yet even begun to un…

The null hypothesis should not be that intelligence requires quantum processes. We'd need to show that: (1) the brain uses this process (2) that it is necessary for certain types of brain functions. Until we run into a wall let's not assume we need more sky ladders.

Re: Superintelligence: The Idea That Eats Smart People

#14

I did read the article through, but made up my mind that the author is presenting a flawed argument when I saw how quickly he skimmed through his base premises, not really giving them much in terms of fair thought. In particular, I don't see how he can so blithely assume so easily that there is no quantum effect in the brain structure. I feel there's some degree of arrogance there, as we have not yet even begun to un…

> In particular, I don't see how he can so blithely assume so easily that there is no quantum effect in the brain structure.

Read it more carefully, because that's not what he did. He is saying "The AI riskers claim 'If you accept X, then you must accept Y'", where X is "the brain does not use quantum effects" and Y is "AI apocalypse". He does not himself take a position on X, but argues against the X=>Y implication.

And it's not really relevant, but for what it's worth, the majority consensus among neuroscientists is that the brain does not use quantum mechanical effects and can be modeled using classical physics alone. Roger Penrose is in the minority on this question.

Re: Superintelligence: The Idea That Eats Smart People

#15

I think brains very probably use quantum effects in ways we might not even be able to study with anything close to today's technology. As a result, individual neurons or groups of neurons can be way more complicated than we are expecting them to be. I'd say we're at least 2 major revolutions away from even coming close to what a chimpanzee's intellect, much less a human's.

Is there any evidence that the functioning of neurons requires consideration of quantum effects acting on them?

Maybe that's the case, but this sounds like it goes against Occam's razor, and give a lot of extra credit to the chaotic process of evolution that it was meaningfully able to harness these quantum effects.

Re: Superintelligence: The Idea That Eats Smart People

#16
post #4

This article explicitly endorses argument ad hominem: "These people are wearing funny robes and beads, they live in a remote compound, and they speak in unison in a really creepy way. Even though their arguments are irrefutable, everything in your experience tells you you're dealing with a cult. Of course, they have a brilliant argument for why you should ignore those instincts, but that's the inside view talking. Th…

Er, that wasn't inventing theories about time travel , just about time.

SR and GR explicitly allow time-travel into the future. Which isn't a fully general Time Machine, of course, but is a huge change from 19th-century physics. If SR had just been invented today, and someone who thought it was crazy and didn't know the math was writing a blog post about it, I 100% expect they'd call it "the time travel theory" or some such thing.

Re: Superintelligence: The Idea That Eats Smart People

#17

I think brains very probably use quantum effects in ways we might not even be able to study with anything close to today's technology. As a result, individual neurons or groups of neurons can be way more complicated than we are expecting them to be. I'd say we're at least 2 major revolutions away from even coming close to what a chimpanzee's intellect, much less a human's.

This is at least partly relevant to the discussion: http://www.smbc-comics.com/comic/the-talk-3

As a shorthand "quantum effects" are often hand-waved as crazy powerful "weird" things, but we can certainly model them and they really aren't as "magic" as a lot of popular science would have one believe (as much as even some of us otherwise rational people so strongly wish to believe in quantum magic).

Re: Superintelligence: The Idea That Eats Smart People

#18

'In particular, there's no physical law that puts a cap on intelligence at the level of human beings.' Maybe not, but there are definitely very physical laws governing everything else, that a superintelligent being's ambitions would run into. A superintelligent being isn't going to be able to build a superliminal reactionless drive if the laws of the universe say it isn't possible. More relevant, a superintelligent b…

The place where AI alarmists seem to forget this most often is in computational complexity, and particularly in the power of super-hyper-computers to simulate reality. Bostrom in particular doesn't seem to appreciate the constraints complexity theory puts on what an AI could calculate (unless he thinks P=NP).

Re: Superintelligence: The Idea That Eats Smart People

#19

I think brains very probably use quantum effects in ways we might not even be able to study with anything close to today's technology. As a result, individual neurons or groups of neurons can be way more complicated than we are expecting them to be. I'd say we're at least 2 major revolutions away from even coming close to what a chimpanzee's intellect, much less a human's.

chemistry uses quantum effects .... so of course brains do.

I think you have to be a bit more specific to claim something particularly special.

I think it's much more likely the important difference is that brains are built in 3D allowing far far more connectivity than wiring in ~5 layers of metal between 2D transistors in the same plane does - it's that added complexity we don't have the technology to reproduce (yet) that's the issue

Re: Superintelligence: The Idea That Eats Smart People

#20
post #4

This article explicitly endorses argument ad hominem: "These people are wearing funny robes and beads, they live in a remote compound, and they speak in unison in a really creepy way. Even though their arguments are irrefutable, everything in your experience tells you you're dealing with a cult. Of course, they have a brilliant argument for why you should ignore those instincts, but that's the inside view talking. Th…

> "if they look like a crank, ignore everything they say", then you miss special relativity (and later general relativity).

Uh ... https://en.wikipedia.org/wiki/History_of_special_relativity#...

Post reply on HN