More generally, the author doesn’t operationalize any of their terms or get out of the weeds of their argument. What constitutes AGI? Even if LLMs do continue to improve at the current rate (as measured by some synthetic benchmark), why do we assume that said improvement will be what’s needed to bridge the gap between the capabilities of current LLMs and AGI?
From GPT-4 to AGI: Counting the OOMs
41–50 of 77 posts
Re: From GPT-4 to AGI: Counting the OOMs
#42> uses your softwares This grammatical mistake drives me nuts. I notice it is common with ESLs for some reason.
Re: From GPT-4 to AGI: Counting the OOMs
#43AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
Re: From GPT-4 to AGI: Counting the OOMs
#44AGI is not a continuum from LLMs; true intelligence is characterized by comprehension, reasoning, and self-awareness, transcending mere data patterns.
What is an abstract reasoning task that your average 15 year old (who has "general intelligence") can do that you think LLMs can't do?
Re: From GPT-4 to AGI: Counting the OOMs
#45It's really good morsel by morsel, it's a nice survey of well-informed thought, but then it just sort of waves it hands, screams "The ~Aristocrats~ AGI!" at the end.
More precisely, not direct quote: "GPT-4 is like a smart high schooler, it's a well-informed estimate that compute spend will expand by a factor similar to GPT-2 to GPT-4, so I estimate we'll do a GPT-2 to GPT-4 qualitative leap from GPT-4 by 2027, which is AGI.
"Smart high schooler" and "AGI" aren't plottable Y-axis values. OOMs of compute are.
It's strange to present this as well-informed conclusion based on trendlines that tells us where AGI would hit, and I can't help but call intentional click bait, because we know the author knows this: they note at length things like "we haven't even scratched the surface on system II thinking, ex. LLMs can't successfully emulate being given 2 months to work on a problem versus having to work on it immediately"
Re: From GPT-4 to AGI: Counting the OOMs
#46Earlier quoted context omitted.
At this point I’m willing to short ANY traditional company that is pivoting to use “AI”. I firmly believe not using AI is the more efficient route, anything else just invites bloat
I watched a secretary take business cards and 1 by 1 copy them into our client DB last week. All day. I showed her how to use the ChatGPT app, photo of them all, and convert it into an excel. "You just saved me weeks of work this year" Should be some fun shorting (we have over 300 secretaries alone, our support staff is massive).
Re: From GPT-4 to AGI: Counting the OOMs
#47Re: From GPT-4 to AGI: Counting the OOMs
#48I’m very skeptical of any future prediction whose main evidence is an extrapolation of existing trendlines. Moore’s Law - frequently referenced in the original article - provides a cautionary tale for such thinking. Plenty of folks in the 90’s relied on a shallow understanding of integrated circuits and computers more generally to extrapolate extraordinary claims of exponential growth in computing power which obvious…
More generally, how do we even define or recognize general intelligence or consciousness? And if we recognize intelligence or consciousness does that come with legal rights and protections equal to what we offer people today?
Re: From GPT-4 to AGI: Counting the OOMs
#49Earlier quoted context omitted.
I watched a secretary take business cards and 1 by 1 copy them into our client DB last week. All day. I showed her how to use the ChatGPT app, photo of them all, and convert it into an excel. "You just saved me weeks of work this year" Should be some fun shorting (we have over 300 secretaries alone, our support staff is massive).
Business card scanners have been around since the earliest versions of the iPhone, but I guess thank you ChatGPT for discovering OCR
Re: From GPT-4 to AGI: Counting the OOMs
#50Earlier quoted context omitted.
Business card scanners have been around since the earliest versions of the iPhone, but I guess thank you ChatGPT for discovering OCR
Are there any good OCR packages that are state of the art for general-purpose transcription? (i.e. give it a business card and get it to format it for you, give it a comic and have it transcribe it, give it nutritional info and have it table it)? When I looked recently I pretty much just got GPT-4o as the best API.