91–100 of 213 posts
It’s just so much more efficient than running their AI control software on silicon-based hardware!
What often gets overlooked in these discussions is how much of the human brain is hardwired as a consequence of millions of years of evolution. Approximately 85% of human genes are used to encode the structure of the brain [0]. I find this particularly impressive when I consider how complex the rest of the body is. To relate this to LLMs, I'm tempted to think this is more like pre-training rather than straightforward…
Earlier quoted context omitted.
> If some day AGI happens and can exists on its own, wouldn’t that prove that intelligence is a base requirement for intelligence to happen in the first place ? No, it would not.
Thank you for your powerful dogmatic argument
The comparison doesn't really hold. He is comparing energy spend during inference in humans with energy spend during training in LLM's. Humans spend their lifetimes training their brain so one would have to sum up the total training time if you are going to compare it to the training time of LLM's. At age 30 the total energy use of the brain sums up to about 5000 Wh, which is 1440 times more efficient. But at age 30…
For every calorie a human consumes, hundreds or thousands more are used by external support systems. So yeah, you do use 2000 calories a day, but unless you live in an isolated jungle tribe, vast amounts of energy are consumed on delivering you food, climate control, electricity, water, education, protection, entertainment and so on.
Earlier quoted context omitted.
No, only a brain can "think" and be original. A computer is limited to what we input to it. An "AI" simply recapitulates what it was trained on.
Do a little exercise for me. Try to be as creative as you can be and imagine how a space alien might look. It's a combination of what you have already seen, read about or heard of, isn't it?
That being said, you are assuming that something alien is from space, and that they would be something that could even be visually experienced.
The comparison doesn't really hold. He is comparing energy spend during inference in humans with energy spend during training in LLM's. Humans spend their lifetimes training their brain so one would have to sum up the total training time if you are going to compare it to the training time of LLM's. At age 30 the total energy use of the brain sums up to about 5000 Wh, which is 1440 times more efficient. But at age 30…
I don't think this is true personally, ideally as children, we spend out time having fun and learning about the world is a side effect. This borg like thinking applied to intelligence because we have LLMs is unusual to me.
I learned surfing through play and enjoyment, not through training like a robot.
We can train for something with intention, but I think that is mostly a waste of energy, albeit necessary on occasion.
Earlier quoted context omitted.
Do a little exercise for me. Try to be as creative as you can be and imagine how a space alien might look. It's a combination of what you have already seen, read about or heard of, isn't it?
I see it quite differently, we don't have to be so creative, we need to get better at appreciating what already exists. Think about how far out most sea creatures really are, a bluebottle, a starfish for example... Personally I think there is a bit of evidence in your comment that we don't really understand our minds or cognition very well.
Earlier quoted context omitted.
Then you must also take that cost into account when calculating the cost of training LLMs, as well as the cost humans operating the devices and their respective individual brain development. LLMs are always an additional cost, never more efficient because they add to the calculation, if you look at it that way.
Only if we are counting the cost to generate all the inputs to training, and not just the training itself - it just depends on the scope of the analysis. (i.e. taken to the extreme, as humans learn from their environment, do we have to count all energy that has gone into creating the world as we know it?)
"If you wish to make an apple pie from scratch you must first invent the universe"
The comparison doesn't really hold. He is comparing energy spend during inference in humans with energy spend during training in LLM's. Humans spend their lifetimes training their brain so one would have to sum up the total training time if you are going to compare it to the training time of LLM's. At age 30 the total energy use of the brain sums up to about 5000 Wh, which is 1440 times more efficient. But at age 30…
Humans spend their lifetimes training their brain I don't think this is true personally, ideally as children, we spend out time having fun and learning about the world is a side effect. This borg like thinking applied to intelligence because we have LLMs is unusual to me. I learned surfing through play and enjoyment, not through training like a robot. We can train for something with intention, but I think that is mos…
What do you think "play" is? Animals play to learn about themselves and the world, you see most intelligent animals play as kids with the play being a simplification of what they do as adults. Human kids similarly play fight, play build things, play cook food, play take care of babies etc, it is all to make you ready for an adult life.
Playing is fun since playing helps us learn, otherwise we wouldn't evolve to play, we would evolve to be like ants that just work all day long if that was more efficient. So the humans who played around beat those who worked their ass off, otherwise we would all be hard workers.
I guess this explains why the machines in The Matrix went to so much effort to create the matrix and “farm” humans for their brain energy. It’s just so much more efficient than running their AI control software on silicon-based hardware!