Live data from Hacker News

From GPT-4 to AGI: Counting the OOMs

situational-awareness.ai

41–50 of 77 posts

Re: From GPT-4 to AGI: Counting the OOMs

#41
I’m very skeptical of any future prediction whose main evidence is an extrapolation of existing trendlines. Moore’s Law - frequently referenced in the original article - provides a cautionary tale for such thinking. Plenty of folks in the 90’s relied on a shallow understanding of integrated circuits and computers more generally to extrapolate extraordinary claims of exponential growth in computing power which obviously didn’t come to pass; counterarguments from actual experts were often dismissed with the same kind of rebuttal we see here, i.e. “that problem will magically get solved once we turn our focus to it.”

More generally, the author doesn’t operationalize any of their terms or get out of the weeds of their argument. What constitutes AGI? Even if LLMs do continue to improve at the current rate (as measured by some synthetic benchmark), why do we assume that said improvement will be what’s needed to bridge the gap between the capabilities of current LLMs and AGI?

Re: From GPT-4 to AGI: Counting the OOMs

#42
post #21

> uses your softwares This grammatical mistake drives me nuts. I notice it is common with ESLs for some reason.

I am non-native speaker and can confirm that I can't remember how many times my grammar checker complains about my uses of "softwares" and "taxons"

Re: From GPT-4 to AGI: Counting the OOMs

#43
post #5

AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.

What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?

Drawing a room without an elephant in it.

Re: From GPT-4 to AGI: Counting the OOMs

#44
post #5

AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.

What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?

Counting the number of “r”s in “strawberry”

Re: From GPT-4 to AGI: Counting the OOMs

#45
Gah this is the second time I got tricked into reading this entire thing, it's long, and it's impossible to know until the very end they're building up to nothing.

It's really good morsel by morsel, it's a nice survey of well-informed thought, but then it just sort of waves it hands, screams "The ~Aristocrats~ AGI!" at the end.

More precisely, not direct quote: "GPT-4 is like a smart high schooler, it's a well-informed estimate that compute spend will expand by a factor similar to GPT-2 to GPT-4, so I estimate we'll do a GPT-2 to GPT-4 qualitative leap from GPT-4 by 2027, which is AGI.

"Smart high schooler" and "AGI" aren't plottable Y-axis values. OOMs of compute are.

It's strange to present this as well-informed conclusion based on trendlines that tells us where AGI would hit, and I can't help but call intentional click bait, because we know the author knows this: they note at length things like "we haven't even scratched the surface on system II thinking, ex. LLMs can't successfully emulate being given 2 months to work on a problem versus having to work on it immediately"

Re: From GPT-4 to AGI: Counting the OOMs

#46
post #40

Earlier quoted context omitted.

At this point I’m willing to short ANY traditional company that is pivoting to use “AI”. I firmly believe not using AI is the more efficient route, anything else just invites bloat

I watched a secretary take business cards and 1 by 1 copy them into our client DB last week. All day. I showed her how to use the ChatGPT app, photo of them all, and convert it into an excel. "You just saved me weeks of work this year" Should be some fun shorting (we have over 300 secretaries alone, our support staff is massive).

Business card scanners have been around since the earliest versions of the iPhone, but I guess thank you ChatGPT for discovering OCR

Re: From GPT-4 to AGI: Counting the OOMs

#47
It’s hard to make LLMs ignore what they were trained to generate. It’s easy for humans. Isn’t that an obstacle on the path to AGI? I was doing trivial tests that demand LLMs to swim against their probability distributions at inference time, and they don’t like this.

Re: From GPT-4 to AGI: Counting the OOMs

#48
post #41

I’m very skeptical of any future prediction whose main evidence is an extrapolation of existing trendlines. Moore’s Law - frequently referenced in the original article - provides a cautionary tale for such thinking. Plenty of folks in the 90’s relied on a shallow understanding of integrated circuits and computers more generally to extrapolate extraordinary claims of exponential growth in computing power which obvious…

I'm similarly skeptical of any prediction that ignores the fact that human intelligence and consciousness is emergent. LLMs don't seem particularly intelligent to me today, but how can I trust that their perceived limitation today won't lead to intelligence tomorrow or next year?

More generally, how do we even define or recognize general intelligence or consciousness? And if we recognize intelligence or consciousness does that come with legal rights and protections equal to what we offer people today?

Re: From GPT-4 to AGI: Counting the OOMs

#49
post #40

Earlier quoted context omitted.

I watched a secretary take business cards and 1 by 1 copy them into our client DB last week. All day. I showed her how to use the ChatGPT app, photo of them all, and convert it into an excel. "You just saved me weeks of work this year" Should be some fun shorting (we have over 300 secretaries alone, our support staff is massive).

Business card scanners have been around since the earliest versions of the iPhone, but I guess thank you ChatGPT for discovering OCR

Are there any good OCR packages that are state of the art for general-purpose transcription? (i.e. give it a business card and get it to format it for you, give it a comic and have it transcribe it, give it nutritional info and have it table it)? When I looked recently I pretty much just got GPT-4o as the best API.

Re: From GPT-4 to AGI: Counting the OOMs

#50

Earlier quoted context omitted.

Business card scanners have been around since the earliest versions of the iPhone, but I guess thank you ChatGPT for discovering OCR

Are there any good OCR packages that are state of the art for general-purpose transcription? (i.e. give it a business card and get it to format it for you, give it a comic and have it transcribe it, give it nutritional info and have it table it)? When I looked recently I pretty much just got GPT-4o as the best API.

Surya https://github.com/VikParuchuri/surya and Marker https://github.com/VikParuchuri/marker
Post reply on HN