Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Why your brain is 3 milion more times efficient than GPT-4

grski.pl

Post reply on HN
Print view View original

51–60 of 213 posts

Re: Why your brain is 3 milion more times efficient than GPT-4

#51

Post by eloeffler »

wanderingmind wrote: post #46
cynusx wrote: post #31

The comparison doesn't really hold. He is comparing energy spend during inference in humans with energy spend during training in LLM's. Humans spend their lifetimes training their brain so one would have to sum up the total training time if you are going to compare it to the training time of LLM's. At age 30 the total energy use of the brain sums up to about 5000 Wh, which is 1440 times more efficient. But at age 30…

Not just that the brain of a newborn comes pretrained with billions of years of evolution. There is an energy cost associated with that which must be taken into account

Then you must also take that cost into account when calculating the cost of training LLMs, as well as the cost humans operating the devices and their respective individual brain development.

LLMs are always an additional cost, never more efficient because they add to the calculation, if you look at it that way.

Re: Why your brain is 3 milion more times efficient than GPT-4

#52

Post by londons_explore »

cynusx wrote: post #31

The comparison doesn't really hold. He is comparing energy spend during inference in humans with energy spend during training in LLM's. Humans spend their lifetimes training their brain so one would have to sum up the total training time if you are going to compare it to the training time of LLM's. At age 30 the total energy use of the brain sums up to about 5000 Wh, which is 1440 times more efficient. But at age 30…

> At age 30 the total energy use of the brain sums up to about 5000 Wh,

That doesn't sound right... 30 years * 20 Watts = 1.9E10 Joules = 5300 kWh.

Re: Why your brain is 3 milion more times efficient than GPT-4

#53

Post by assimpleaspossi »

I don't care.

I've come to the conclusion that gpt and gemini and all the others are nothing but conversational search engines. They can give me ideas or point me in the right direction but so do regular search engines.

I like the conversation ability but, in the end, I cannot trust their results and still have to research further to decide for myself if their results are valid.

Re: Why your brain is 3 milion more times efficient than GPT-4

#54

Post by mjburgess »

assimpleaspossi wrote: post #53

I don't care. I've come to the conclusion that gpt and gemini and all the others are nothing but conversational search engines. They can give me ideas or point me in the right direction but so do regular search engines. I like the conversation ability but, in the end, I cannot trust their results and still have to research further to decide for myself if their results are valid.

One amusing way to put this is that LLMs energy requirements arent self-contained, since they use the energy of the human prompter to both prompt and verify the output.

Reminds me of a similar argument about correctly pricing renewable power: since it isnt always-on (etc.) it requires a variety of alternative systems to augment it which aren't priced in. Ie., converting entirely to renewables isnt possible at the advertised price.

In this sense, we cannot "convert entirely to LLMs" for our tasks, since there's still vast amounts of labour in prompt/verify/use/etc.

Re: Why your brain is 3 milion more times efficient than GPT-4

#55

Post by TheDong »

The vector db comparison is written so much like an advertisement that I cannot possibly take it seriously.

> Shared slack channel if problems arise? There you go. You wanna learn more? Sure, here are the resources. Workshops? Possible.

> wins by far [...] most importantly community plus the company values.

Like, talking about "You can pay the company for workshops" and "company values" just makes it feel so much like an unsubtle paid-for ad I can't take it seriously.

All the actual details around the vectorDB (for example a single actual performance number, a clear description of the size of dataset or problem) is missing, making this all feel like a very handwavy comparison, and the final conclusion is just so strong, and worded in such a strange way, it feels disingenuous.

I have no way to know if this post is actually genuine, not a piece of stealth advertising, but it hits so many alarm bells in my head that I can't help but ignore its conclusions about every database.

Re: Why your brain is 3 milion more times efficient than GPT-4

#56

Post by exe34 »

shinycode wrote: post #23
exe34 wrote: post #13

Earlier quoted context omitted.

Do you think the same thing is required for flying? that aeroplanes can only be created by birds?

Intelligence and flying are different things, a leaf falling down a tree « fly » because of laws of nature.

Beautiful analogy! Human intelligence is an extreme on the spectrum of animal intelligence, and evolution by natural selection is the law of nature that made it happen.

Re: Why your brain is 3 milion more times efficient than GPT-4

#57

Post by bamboozled »

assimpleaspossi wrote: post #53

I don't care. I've come to the conclusion that gpt and gemini and all the others are nothing but conversational search engines. They can give me ideas or point me in the right direction but so do regular search engines. I like the conversation ability but, in the end, I cannot trust their results and still have to research further to decide for myself if their results are valid.

As a user, it does feel like a search engine that contains an almost accurate snapshot of many potential results.

Re: Why your brain is 3 milion more times efficient than GPT-4

#59

Post by intended »

bamboozled wrote: post #57
assimpleaspossi wrote: post #53

I don't care. I've come to the conclusion that gpt and gemini and all the others are nothing but conversational search engines. They can give me ideas or point me in the right direction but so do regular search engines. I like the conversation ability but, in the end, I cannot trust their results and still have to research further to decide for myself if their results are valid.

As a user, it does feel like a search engine that contains an almost accurate snapshot of many potential results.

It is often a search engine without ads.

Re: Why your brain is 3 milion more times efficient than GPT-4

#60

Post by imabotbeep2937 »

mihaic wrote: post #58

Genuinely curious who upvoted this and why. The title is clickbait, the writing is long and rambling and it seems to me like the author doesn't have a profound understand of the concepts either, all just to recommend Qdrant as a vector database.

Posted article quality is not always very good here lately.

Clickholes get too many votes.

Post reply on HN