Live data from Hacker News

Three Years from GPT-3 to Gemini 3

oneusefulthing.org

71–80 of 336 posts

Re: Three Years from GPT-3 to Gemini 3

#71

Every time I see an article like this, it's always missing --- but is it any good, is it correct? They always show you the part that is impressive - "it walked the tricky tightrope of figuring out what might be an interesting topic and how to execute it with the data it had - one of the hardest things to teach." Then it goes on, "After a couple of vague commands (“build it out more, make it better”) I got a 14 page p…

This is a variation of the Gell-Mann amnesia effect: https://en.wikipedia.org/wiki/Gell-Mann_amnesia_effect

Re: Three Years from GPT-3 to Gemini 3

#72

Every time I see an article like this, it's always missing --- but is it any good, is it correct? They always show you the part that is impressive - "it walked the tricky tightrope of figuring out what might be an interesting topic and how to execute it with the data it had - one of the hardest things to teach." Then it goes on, "After a couple of vague commands (“build it out more, make it better”) I got a 14 page p…

The author goes into the strengths and weaknesses of the paper later in the article.

Re: Three Years from GPT-3 to Gemini 3

#73
post #53
post #48

Earlier quoted context omitted.

I think the point is we’re getting there. These models are growing up real fast. Remember 54% of US adults read at or below the equivalent of a sixth-grade level.

> Remember 54% of US adults read at or below the equivalent of a sixth-grade level. The sane conclusion would be to invest in education, not to dump hundreds of billions of llms, but ok

Education is not just a funding issues. Policy choices, like making it impossible for students to fail which means they have no incentive to learn anything, can be more impactful.

Re: Three Years from GPT-3 to Gemini 3

#74
post #53
post #48

Earlier quoted context omitted.

I think the point is we’re getting there. These models are growing up real fast. Remember 54% of US adults read at or below the equivalent of a sixth-grade level.

> Remember 54% of US adults read at or below the equivalent of a sixth-grade level. The sane conclusion would be to invest in education, not to dump hundreds of billions of llms, but ok

Education funding is highest in places that have the worst results. Try again.

Re: Three Years from GPT-3 to Gemini 3

#75
post #68

Earlier quoted context omitted.

Not true, most people are not upper-middle class anti-tax wackos. They benefit from those people being taxed.

That's why you phrase it as "woke liberals turning your children gay!" In USA K-12 education costs about $300k 350 million people, want to get 175 million of them better educated, but we've already spent $52 trillion dollars on educating them so far

The people most vociferously for conservative values are middle class, small business owners, or upper class, though the true upper class are libertine (notice who participated in the Epstein affair). The working class is filled with all kinds of very diverse people united by the fact they have to work for a living and often can't afford e.g. expensive weddings. Some of them are religious, a whole bunch aren't. It's easy to be disillusioned with formal institutions that seem to not care at all about you.

Unfortunately, a lot of these people have either concluded it is too difficult to vote, can't vote, or that their votes don't matter (I don't think they're wrong). Their unions were also destroyed. Some of them vote against their interests, but it's not clear that their interests are ever represented, so they vote for change instead.

Re: Three Years from GPT-3 to Gemini 3

#76
post #48

Earlier quoted context omitted.

I think the point is we’re getting there. These models are growing up real fast. Remember 54% of US adults read at or below the equivalent of a sixth-grade level.

A question for the not-too-distant future: What use is an LLM in an illiterate society?

Automatic speech recognition and speech to text models are also growing up real fast.

Re: Three Years from GPT-3 to Gemini 3

#77

It is interesting that most of our modes of interaction with AI is still just textboxes. The only big UX change in that the last three years has been the introduction of the Claude Code / OpenAI Codex tools. They feel amazing to use, like you're working with another independent mind. I am curious what the user interfaces of AI in the future will be, I think whoever can crack that will create immense value.

People get a little too hung up on finding the AI UI. It does not seem all necessary that the interfaces will be much different (while the underlying tech certainly will be).

Text and boxes and tables and graphs is what we can cope with. And while the AI is going to change much, we are not.

Re: Three Years from GPT-3 to Gemini 3

#78
post #76

Earlier quoted context omitted.

A question for the not-too-distant future: What use is an LLM in an illiterate society?

Automatic speech recognition and speech to text models are also growing up real fast.

But will an illiterate person be able to articulate themselves well enough to get the LLM to do what they want, even with a speech interface?

Will they possess the skills (or even the vocabulary) to understand the output?

We won't know for another 20 years, perhaps.

Re: Three Years from GPT-3 to Gemini 3

#79
post #55

How many trillions of dollars have we spent on these things? Would we not expect similar levels of progress in other industries given such massive investment?

I’m not sure even $1T has been spent. Pledged != spent.

Some estimates have it at ~$375B by the end of 2025. It makes sense, there are only so many datacenters and engineers out there and a trillion is a lot of money. It’s not like we’re in health care. :)

https://hai.stanford.edu/ai-index/2025-ai-index-report/econo...

Re: Three Years from GPT-3 to Gemini 3

#80
post #48

Earlier quoted context omitted.

I think the point is we’re getting there. These models are growing up real fast. Remember 54% of US adults read at or below the equivalent of a sixth-grade level.

A question for the not-too-distant future: What use is an LLM in an illiterate society?

Absurd question. The correct one is "what use is an illiterate in an LLM society".
Post reply on HN