Live data from Hacker News

Ray Kurzweil does not understand the brain

scienceblogs.com

61–70 of 227 posts

Re: Ray Kurzweil does not understand the brain

#61
post #50

I'm not so sure about the simulation, but Ray's right that the brain cannot be more complex than the data that specifies it, speaking information-theoretically. A biologist probably wouldn't get this, because he has too much knowledge of how difficult and complex the actual translation is. It's a mathematical idea, like non-constructive proofs, which freak out sensible folk - and rightfully so. ( EDIT no offence inte…

> I'm not so sure about the simulation, but Ray's right that the brain cannot be more complex than the data that specifies it

Which would be true if the DNA specification for that particular part of the body was the only part of what specifies the brain. Myers is pointing out that assertion is patently false. The environment of developing creature and the interactions between cell types and their environment (and themselves) is a giant information content multiplier, and the DNA need not explicitly specify any of this information for it to exist and be relevant.

Bringing this to a familiar compsci example; imagine software for creating neural net recognizers. You can look at the source code for a net and say, "This will take N inputs and produce N outputs" You can look at a finished classifier and say, "Ah, I see what this does! It tells the airbags in this car when to deploy!" But that's as far as you can go without the training data that was used to train the classifier. This is a doubly good example because it's often very difficult to determine HOW a complex neural net is doing what it does, but it's fairly easy to explain how to train one to do that task.

Re: Ray Kurzweil does not understand the brain

#62
> The design of the brain is in the genome.

Given how much computation takes to "decompress" information about what a protein is built of into 3d layout of that protein (vide folding@home), statement that you could "decode" half of the genome into working simulated system is bold to say the least.

Trouble with simulating human 1 to 1 is not with how complex human itself is but with how complex, bizzare and computationally powerful is physical hardware on which program "be human" runs.

Re: Ray Kurzweil does not understand the brain

#63
post #50

I'm not so sure about the simulation, but Ray's right that the brain cannot be more complex than the data that specifies it, speaking information-theoretically. A biologist probably wouldn't get this, because he has too much knowledge of how difficult and complex the actual translation is. It's a mathematical idea, like non-constructive proofs, which freak out sensible folk - and rightfully so. ( EDIT no offence inte…

> I'm not so sure about the simulation, but Ray's right that the brain cannot be more complex than the data that specifies it Which would be true if the DNA specification for that particular part of the body was the only part of what specifies the brain. Myers is pointing out that assertion is patently false. The environment of developing creature and the interactions between cell types and their environment (and the…

Is this sort of like having a pre-processor and system code to get a program loaded, linked and running?

Re: Ray Kurzweil does not understand the brain

#64
post #44

Earlier quoted context omitted.

It is deadly dangerous for me to watch a clip from that film. It could inspire dozens of hours of rage-filled but closely-argued physics lectures. Given the slightest provocation, I will go all xkcd.com/386 on its ass and my actual career will die of neglect. Now, I need to go calm myself by fixing some bugs before I start to throw things. ;)

Turn that rage into a popular webcomic, then you could start a new career!

I keep meaning to practice some drawing. I'm half serious about that.

One of my personal heroes is this guy:

http://www.timhunkin.com/

That Randall Munroe is also a personal hero probably goes without saying at this point.

Re: Ray Kurzweil does not understand the brain

#65
I'm a life-long programmer who presently works in software, but I studied biology in college... mostly because I wanted to learn about learning by studying how living systems do it.

Biological systems are nothing like anything we would ever engineer, and to understand them we must remove our "anthropocentric engineer goggles" and look at them for what they are. Analogies between biological systems and computers, software, machines, etc. are very loose analogies meant to illustrate a point. Never take these analogies too seriously.

DNA is not a program-- it is a molecule, and one that may very well do things at the quantum level that are biologically important.

The brain is not a neural network. It is an interconnected colony of living cells of a variety of types, and it has been shown that all types of cells in the brain are involved in cognition.

We are nowhere near anything with the parallelism or information density of the brain. Getting close would take an advancement in computer technology of the magnitude of the transition from vacuum tubes in individual boxes to a 32nm Core i7. Nature has had billions of years, and it is way ahead of us. There's a nascent field called quantum biology that suggests that the brain may very well be a quantum computer, so maybe quantum computers are the vacuum tubes->ICs scale transition I am speaking of.

I think it's now possible with a big rack of multi-core machines in an MPI cluster to approach the capabilities of a fruit fly's brain.

Cells are not machines. I don't think we have the language to really describe what they are perfectly, but the closest I can come is "stochastic quantum probability field device." A bacterial flagellum is not a "motor," it is a quantum-scale chemo-electro-motive... well... our language breaks down. Like Feynman said, don't tell stories. Just speak literally and then use math.

Actually, come to think of it, there's one engineering analogy that might work for biology. Biology is quantum-scale nanotechnology. Yeah, that's pretty close.

(On a related tangent, I've found that many engineers are sympathetic to intelligent design type arguments against evolution. This is because they try to think about biology like engineers and take these machine analogies literally. It just doesn't work like that.)

Re: Ray Kurzweil does not understand the brain

#66
post #63

Earlier quoted context omitted.

> I'm not so sure about the simulation, but Ray's right that the brain cannot be more complex than the data that specifies it Which would be true if the DNA specification for that particular part of the body was the only part of what specifies the brain. Myers is pointing out that assertion is patently false. The environment of developing creature and the interactions between cell types and their environment (and the…

Is this sort of like having a pre-processor and system code to get a program loaded, linked and running?

Perhaps, only the pre-processor would be in a feedback loop with the early parts stages of the program life-cycle. Typically the linker and pre-processor are one way operations. In a developing organism, the environment feeds back on the cells developing and triggers new responses which causes new environmental changes which causes new feedback.

Biology is full of bizarre examples of when this process goes awry and our bodies have bizarre features. Dawkins's example of the Laryngeal nerve that makes a crazy loop down into the mammalian chest cavity is the classic example.

Re: Ray Kurzweil does not understand the brain

#67
post #50

I'm not so sure about the simulation, but Ray's right that the brain cannot be more complex than the data that specifies it, speaking information-theoretically. A biologist probably wouldn't get this, because he has too much knowledge of how difficult and complex the actual translation is. It's a mathematical idea, like non-constructive proofs, which freak out sensible folk - and rightfully so. ( EDIT no offence inte…

This strikes me as very similar to a Mandelbrot fractal. The fractal is overwhelmingly complex and intricate, but wholly mathematically described by a very simple formula. The complexity of the brain is similar: A few simple cells and proteins can interact in extraordinarily complex ways. Some biologists understand this just fine, thank you very much.

In fact, some biologists have even written books on the subject:

http://books.google.com/books?id=lZcSpRJz0dgC&lpg=PP1&#3...

Re: Ray Kurzweil does not understand the brain

#68
post #24

Earlier quoted context omitted.

why would complex interactions not emerge from a computer simulation One answer is "They will, and surprisingly quickly. But they will be a completely different set of complex interactions than are observed in the real world, because of some roundoff error in the binary representation of the N th digit of some apparently unimportant constant. Unfortunately, because the system is complex, you'll probably spend the res…

If you wanted an exact simulation, the n-th digit is important. But if you just want some system where some other (possibly intelligent) behaviour emerges, the n-th digit is not important.

Well, it would by all means be awesome if we could build an intelligent system that didn't match the one we already have.

And we even have an existence proof that such a thing is possible, given enough design time. Unfortunately, the existence proof says nothing about the odds of doing so very quickly -- in less than, say, a million years, which is very quick by historical standards.

Re: Ray Kurzweil does not understand the brain

#69
post #50

I'm not so sure about the simulation, but Ray's right that the brain cannot be more complex than the data that specifies it, speaking information-theoretically. A biologist probably wouldn't get this, because he has too much knowledge of how difficult and complex the actual translation is. It's a mathematical idea, like non-constructive proofs, which freak out sensible folk - and rightfully so. ( EDIT no offence inte…

but Ray's right that the brain cannot be more complex than the data that specifies it, speaking information-theoretically.

You're conflating two very different concepts of complexity here.

One is the complexity of a static state of information, and the other is the complexity arising from dynamical systems.

As roadnottaken pointed out, fractals are perfect examples of systems that are described by very "simple" formulas, yet contain infinite complexity. It could therefore be said that the simple equation of the Mandelbrot set represents infinite complexity.

However, if you take a particular iteration of the formula, then you can get a finite concept of its complexity, i.e. how many bits it takes to represent the image you're seeing.

So, to say that the "the brain cannot be more complex than the data that specifies it" is true in one sense, but completely useless in another.

To put this into terms of the Mandelbrot, you can gather up all the bits that represents some particular iteration of the Mandelbrot, but that doesn't tell you anything about how it works, or even how to generate the next frame. You need the equation for that.

That's just one place where Ray fails. The second is the lingering question of whether computers in their current state are even capable of "simulating" a brain. It's still not an answered question of what the role of the non-determinism found in Quantum Mechanics plays in the brain and the interactions of various chemicals. It was recently shown that DNA relies on QM entanglement to "hold it together". If it turns out that non-determinism and QM effects play a crucial role in biology (which they almost certainly do), then the very rigid and deterministic system that is the CPU may simply be incapable of simulating a human brain.

Re: Ray Kurzweil does not understand the brain

#70

Myers is attacking Kurzweil on the assumption that Kurzweil is actually proposing that the brain's structure should be reverse-engineesed from DNA, which would be intractably hard. Only Kurzweil isn't saying this anywhere. Instead, he seems to be using DNA as a measure for the amount of irreducible complexity that needs to go into a system that will end up with the complexity of a human brain. Basically, we have no i…

Form my limited understanding, it's simpler than it appears. It's a wire routing problem. Each neuron "knows" where it is going based on the proximity of its fellows, just as other cells know to become a liver based on who their neighbors are. Given a nascent brain, it is trained into an intelligence by external input. Neurons are pruned and connections strengthened.

As I see it, a significant problem is designing a substrate in silicon, or whatever, that has the requisite complexity. I would not be too surprised to find out that the layout program for an AI is not too different in complexity from today's largest software projects.

Post reply on HN