Earlier quoted context omitted.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
differentiating between puppy and a husky in a snowy background without being trained in millions of images?
From GPT-4 to AGI: Counting the OOMs
11–20 of 77 posts
Re: From GPT-4 to AGI: Counting the OOMs
#12AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
Re: From GPT-4 to AGI: Counting the OOMs
#13Re: From GPT-4 to AGI: Counting the OOMs
#14Earlier quoted context omitted.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
differentiating between puppy and a husky in a snowy background without being trained in millions of images?
Re: From GPT-4 to AGI: Counting the OOMs
#15AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
More specifically, something like “whats the best brand of phone”. The LLM just summarizes common knowledge. But even a child will grasp some of the differences and have opinions drawn from experience.
Note that this isn’t just an anthro-good argument. AI systems could have experiences and be trained on long duration tasks with memory of what worked and why.
Re: From GPT-4 to AGI: Counting the OOMs
#16I work at a company with ~50k employees each of whom has different data access rules governed by regulation.
So either (a) you train thousands of models which is cost-prohibitive or (b) it is going to be trained on what is effectively public company data i.e. making the agent pretty useless.
Never really seen how this situation gets resolved.
Re: From GPT-4 to AGI: Counting the OOMs
#17Earlier quoted context omitted.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
Doing any job for more than an hour without completely forgetting it's goals and tasks
Re: From GPT-4 to AGI: Counting the OOMs
#18Re: From GPT-4 to AGI: Counting the OOMs
#19As a software engineer I'm very familiar with "OOM"s and "orders of magnitude", and have never once heard the former used to mean the latter. Perhaps this is a term of art in harder science or maths. I can't help but think here it's likely to confuse the majority as they wonder why the author is conflating memory and compute. Something that might help is for the link to be amended to link to the page as a whole (and…
Re: From GPT-4 to AGI: Counting the OOMs
#20AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?