Live data from Hacker News

2025: The Year in LLMs

simonwillison.net

301–310 of 643 posts

Re: 2025: The Year in LLMs

#301
post #293

Earlier quoted context omitted.

Seems like Nvidia will be focusing on the super beefy GPUs and leaving the consumer market to a smaller player

I don't get why Nvidia can't do both? Is it because of the limited production capabilities of the factories?

Yes. If you're bottlenecked on silicon and secondaries like memory, why would you want to put more of those resources into lower margin consumer products if you could use those very resources to make and sell more high margin AI accelerators instead?

From a business standpoint, it makes some sense to throttle the gaming supply some. Not to the point of surrendering the market to someone else probably, but to a measurable degree.

Re: 2025: The Year in LLMs

#303
post #228

All these improvement in a single year, 2025. While this may seem obvious to those who follows along the AI / LLM news. It may be worth pointing out again ChatGPT was introduced to us in November 2022. I still dont believe AGI, ASI or Whatever AI will take over human in short period of time say 10 - 20 years. But it is hard to argue against the value of current AI, which many of the vocal critics on HN seems to have…

Is the AI progress in 2025 an outstanding breakthrough? Not really. It's impressive but incremental.

Still, the gap between the capabilities of a cutting edge LLM and that of a human is only this wide. There are only this many increments it takes to cross it.

Re: 2025: The Year in LLMs

#304
post #25
post #22

Not in this review: Also the record year in intelligent systems aiding in and prompting human users into fatal self-harm. Will 2026 fare better?

I really hope so. The big labs are (mostly) investing a lot of resources into reducing the chance their models will trigger self-harm and AI psychosis and suchlike. See the GPT-4o retirement (and resulting backlash) for an example of that. But the number of users is exploding too. If they make things 5x less likely to happen but sign up 10x more people it won't be good on that front.

How does a model “trigger” self-harm? Surely it doesn’t catalyze the dissatisfaction with the human condition, leading to it. There’s no reliable data that can drive meaningful improvement there, and so it is merely an appeasement op.

Same thing with “psychosis”, which is a manufactured moral panic crisis.

If the AI companies really wanted to reduce actual self harm and psychosis, maybe they’d stop prioritizing features that lead to mass unemployment for certain professions. One of the guys in the NYT article for AI psychosis had a successful career before the economy went to shit. The LLM didn’t create those conditions, bad policies did.

It’s time to stop parroting slurs like that.

Re: 2025: The Year in LLMs

#305

Earlier quoted context omitted.

"Given the state of robotics" reminds me a lot of what was said about llms and image/video models over the past 3 years. Considering how much llms improved, how long can robotics be in this state? I have to think 3 years from now we will be having the same conversation about robots doing real physical labor. "This is the worst they will ever be" feels more apt.

Robotics is coming FAST. Faster than LLM progress in my opinion.

The question is how rapid the adoption is. The price of failure in the real world is much higher ($$$, environmental, physical risks) vs just "rebuild/regenerate" in the digital realm.

Re: 2025: The Year in LLMs

#307
post #23

Earlier quoted context omitted.

People denied that bicycles could possibly balance even as others happily pedaled by. This is the same thing.

Bicycles don't balance, the human on the bicycle is the one doing the balancing.

Bicycles (without a rider) do balance at sufficient speed via a self steering and correction mechanism of the front axle..

Re: 2025: The Year in LLMs

#310
post #3

Remember, back in the day, when a year of progress was like, oh, they voted to add some syntactic sugar to Java...

That must have been a long time back. Having lived through the time when web pages were served through CGI and mobile phones only existed in movies, when SVMs where the new hotness in ML and people would write about how weird NNs were, I feel like I've seen a lot more concrete progress in the last few decades than this year. This year honestly feels quite stagnant. LLMs are literally technology that can only reproduc…

> This year honestly feels quite stagnant. LLMs are literally technology that can only reproduce the past.

Is this such a big limitation? Most jobs are basically people trained on past knowledge applying it today. No need to generate new knowledge.

And a lot of new knowledge is just combining 2 things from the past in a new way.

Post reply on HN