Live data from Hacker News

From GPT-4 to AGI: Counting the OOMs

situational-awareness.ai

11–20 of 77 posts

Re: From GPT-4 to AGI: Counting the OOMs

#11
post #8
post #5

Earlier quoted context omitted.

What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?

differentiating between puppy and a husky in a snowy background without being trained in millions of images?

Why does it matter how it was trained?

Re: From GPT-4 to AGI: Counting the OOMs

#12
post #5

AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.

What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?

Doing any job for more than an hour without completely forgetting it's goals and tasks

Re: From GPT-4 to AGI: Counting the OOMs

#13
post #9
post #5

Earlier quoted context omitted.

What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?

Actually caring about another person.

TIL "caring" == "abstract reasoning".

Re: From GPT-4 to AGI: Counting the OOMs

#14
post #8
post #5

Earlier quoted context omitted.

What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?

differentiating between puppy and a husky in a snowy background without being trained in millions of images?

I wouldn't say humans are so different. You could argue we've been trained on about one quadrillion bytes of visual data by the time we're 4 years old: https://x.com/ylecun/status/1750614681209983231

Re: From GPT-4 to AGI: Counting the OOMs

#15
post #5

AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.

What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?

Speaking from experience.

More specifically, something like “whats the best brand of phone”. The LLM just summarizes common knowledge. But even a child will grasp some of the differences and have opinions drawn from experience.

Note that this isn’t just an anthro-good argument. AI systems could have experiences and be trained on long duration tasks with memory of what worked and why.

Re: From GPT-4 to AGI: Counting the OOMs

#16
> By the end of this, I expect us to get something that looks a lot like a drop-in remote worker. An agent that joins your company, is onboarded like a new human hire, messages you and colleagues on Slack and uses your softwares, makes ..

I work at a company with ~50k employees each of whom has different data access rules governed by regulation.

So either (a) you train thousands of models which is cost-prohibitive or (b) it is going to be trained on what is effectively public company data i.e. making the agent pretty useless.

Never really seen how this situation gets resolved.

Re: From GPT-4 to AGI: Counting the OOMs

#17
post #5

Earlier quoted context omitted.

What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?

Doing any job for more than an hour without completely forgetting it's goals and tasks

How long do you expect LLMs/agents to be unable to do this?

Re: From GPT-4 to AGI: Counting the OOMs

#19

As a software engineer I'm very familiar with "OOM"s and "orders of magnitude", and have never once heard the former used to mean the latter. Perhaps this is a term of art in harder science or maths. I can't help but think here it's likely to confuse the majority as they wonder why the author is conflating memory and compute. Something that might help is for the link to be amended to link to the page as a whole (and…

[deleted]

Re: From GPT-4 to AGI: Counting the OOMs

#20
post #5

AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.

What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?

Current LLMs have a number of limitations that human reasoning doesn't. Whether these are intrinsic to the technology or can be overcome with larger and better datasets is an open question.
Post reply on HN