From GPT-4 to AGI: Counting the OOMs
situational-awareness.ai
From GPT-4 to AGI: Counting the OOMs
1–10 of 77 posts
Re: From GPT-4 to AGI: Counting the OOMs
#2Also from a month ago: https://news.ycombinator.com/item?id=40584237
Re: From GPT-4 to AGI: Counting the OOMs
#3AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
Re: From GPT-4 to AGI: Counting the OOMs
#4As a software engineer I'm very familiar with "OOM"s and "orders of magnitude", and have never once heard the former used to mean the latter.
Perhaps this is a term of art in harder science or maths. I can't help but think here it's likely to confuse the majority as they wonder why the author is conflating memory and compute.
Something that might help is for the link to be amended to link to the page as a whole (and the unconventional expansion of OOM at the top) rather than the #Compute anchor.
Re: From GPT-4 to AGI: Counting the OOMs
#5AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
Re: From GPT-4 to AGI: Counting the OOMs
#6AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
Reasoning and comprehension aren't reducible to patterns of non-reasoning and non-comprehending components?
Re: From GPT-4 to AGI: Counting the OOMs
#7As a software engineer I'm very familiar with "OOM"s and "orders of magnitude", and have never once heard the former used to mean the latter. Perhaps this is a term of art in harder science or maths. I can't help but think here it's likely to confuse the majority as they wonder why the author is conflating memory and compute. Something that might help is for the link to be amended to link to the page as a whole (and…
As a physician I have the same expectations as you for those two words. Especially given that the link is to an anchor on the middle of the page, I was thinking in units of "OOM". Essentially I was thinking "OK an OOM is a unit for the doubling of RAM" (wrong).
Re: From GPT-4 to AGI: Counting the OOMs
#8AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
differentiating between puppy and a husky in a snowy background without being trained in millions of images?
Re: From GPT-4 to AGI: Counting the OOMs
#9AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
Actually caring about another person.
Re: From GPT-4 to AGI: Counting the OOMs
#10Earlier quoted context omitted.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
differentiating between puppy and a husky in a snowy background without being trained in millions of images?
GPT-4 is also really bad right now about comprehending “new” software libraries (even when I ask it to scrape the web).