(My answer: above the scale of the human brain there’s diminishing returns on more neurons. Two individuals with their own volition are smarter than one individual with double the brain size. We’ll do a lot of research in AI to find that there aren’t any machine learning problems that can’t be run on a computer about the size and speed of a brain, or distributed among some number of independently operating brain sized computers, and that the problem never was scale but just where to focus)
One model to learn them all
21–30 of 51 posts
Re: One model to learn them all
#22Legit question: if human intelligence is fundamentally limited by scale, why aren’t there some humans running around with heads twice as big and twice the neurons? If it’s such an advantage why hasn’t nature selected for it in at least one place on Earth? (My answer: above the scale of the human brain there’s diminishing returns on more neurons. Two individuals with their own volition are smarter than one individual…
Re: One model to learn them all
#23Legit question: if human intelligence is fundamentally limited by scale, why aren’t there some humans running around with heads twice as big and twice the neurons? If it’s such an advantage why hasn’t nature selected for it in at least one place on Earth? (My answer: above the scale of the human brain there’s diminishing returns on more neurons. Two individuals with their own volition are smarter than one individual…
Re: One model to learn them all
#24Legit question: if human intelligence is fundamentally limited by scale, why aren’t there some humans running around with heads twice as big and twice the neurons? If it’s such an advantage why hasn’t nature selected for it in at least one place on Earth? (My answer: above the scale of the human brain there’s diminishing returns on more neurons. Two individuals with their own volition are smarter than one individual…
Brains are very expensive and, for our body size, we have very large brains; evolution had to build a brain that could operate within the calorie constraints imposed by our ecological niche - presumably a hunter-gatherer niche.
If you graph adult body volume relative to gestation time across the placental mammals, there's a good correlation, but humans are an anomaly; for our body volume we should take more than 9 months. So we are kind of born prematurely - the reason? So our heads can fit through the birth-canal. Significantly bigger brains would have likely entailed altering our walking gate, thus potentially sacrificing our ecological niche (and guaranteed source of those much needed calories!). Most of this was taken from Pinker ([0]).
Bostrom ([1]) brings up another interesting point - anything smarter than us would have probably taken longer to evolve than us. So it might not be inaccurate to think of ourselves as the dumbest species that could build an interplanetary species.
My suspicion is that things much smarter than us are very possible; my reasoning is, it just seems so strange to me that the peak of feasible intelligence just so happens to correspond with what can be fed by a hunter-gatherer diet and fit through a birth-canal which fits into the constraints of an upright primate.
It seems more likely to me that we're a local optimum - we're probably close to the optimal design for something as smart as us, in our ecological niche.
[0] - https://en.wikipedia.org/wiki/How_the_Mind_Works [1] - https://en.wikipedia.org/wiki/Superintelligence:_Paths,_Dang...
Re: One model to learn them all
#25Wow. Can someone pull a Hacker News and explain to me why I'm allowed to be super pessimistic about this result? I want to believe.
No need to be super pessimistic, but there is reason to temper your excitement - this is quite preliminary research (little results to indicate much benefit to this - "But the results show that even on the ImageNet task, the presence of such blocks does not detract from performance, and may even slightly improve it."), and is still entirely supervised. Something like this able to learn in a semi-supervised fashion fr…
Hang on tight we are getting there.
Re: One model to learn them all
#26Legit question: if human intelligence is fundamentally limited by scale, why aren’t there some humans running around with heads twice as big and twice the neurons? If it’s such an advantage why hasn’t nature selected for it in at least one place on Earth? (My answer: above the scale of the human brain there’s diminishing returns on more neurons. Two individuals with their own volition are smarter than one individual…
Increased head size == greater risk of death in childbirth
Female hips have already evolved to be as large as possible while still being load-bearing.
It would be interesting to see what the wide-spread use of Caesarean sections would do to the human brain, if we weren't all going to be transhuman within a few generations anyway
As far as whether there are diminishing returns to increased intelligence within one individual, I'd say try taking two people with half of Einstein's IQ and asking them to explain General Relativity
Re: One model to learn them all
#27Re: One model to learn them all
#28Re: One model to learn them all
#29Legit question: if human intelligence is fundamentally limited by scale, why aren’t there some humans running around with heads twice as big and twice the neurons? If it’s such an advantage why hasn’t nature selected for it in at least one place on Earth? (My answer: above the scale of the human brain there’s diminishing returns on more neurons. Two individuals with their own volition are smarter than one individual…
There's nothing saying there won't be such humans, one day. Maybe we'll eventually evolve to Homo Sapiens Megacephalus, with brains twice the size than now. Evolution is an ongoing thing, right?
Btw, I don't think it's ever safe to compare machine learning with human intelligence. So far, it's clear that human learning is completely different to machine learning and human learning is only part of human cognition. It's not easy to use observations on the one to draw conclusions about the other.
Re: One model to learn them all
#30Legit question: if human intelligence is fundamentally limited by scale, why aren’t there some humans running around with heads twice as big and twice the neurons? If it’s such an advantage why hasn’t nature selected for it in at least one place on Earth? (My answer: above the scale of the human brain there’s diminishing returns on more neurons. Two individuals with their own volition are smarter than one individual…
Here's my understanding/interpretation - if I get any details wrong, I hope someone will correct me! Brains are very expensive and, for our body size, we have very large brains; evolution had to build a brain that could operate within the calorie constraints imposed by our ecological niche - presumably a hunter-gatherer niche. If you graph adult body volume relative to gestation time across the placental mammals, the…
I think you're understimating the intelligence required to survive as a hunter-gatherer, individual or species, in a world that keeps wanting to kill you, where the number of things that want to make it easy for you to eat them is exactly 0 (not counting fruit, which is made to be eaten by birds, not humans) and the numer of things that want to eat you is ...very big.
If you think about it, the amount of brainpower needed to survive as a primitive human in the savannah is exactly as much as required to develop modern technology. We got were we are today because our ancestors were smart enough to not be eaten by lions etc.
Of course I'm not saying that smarter things than us aren't possible. There's an element of luck involved in evolution. Maybe we 're not the most powerful intelligence that could have evolved on Earth; but we're certainly the one that did.