Live data from Hacker News

2025: The Year in LLMs

simonwillison.net

21–30 of 643 posts

Re: 2025: The Year in LLMs

#25
post #22

Not in this review: Also the record year in intelligent systems aiding in and prompting human users into fatal self-harm. Will 2026 fare better?

I really hope so.

The big labs are (mostly) investing a lot of resources into reducing the chance their models will trigger self-harm and AI psychosis and suchlike. See the GPT-4o retirement (and resulting backlash) for an example of that.

But the number of users is exploding too. If they make things 5x less likely to happen but sign up 10x more people it won't be good on that front.

Re: 2025: The Year in LLMs

#26
post #22

Not in this review: Also the record year in intelligent systems aiding in and prompting human users into fatal self-harm. Will 2026 fare better?

The people working on this stuff have convinced themselves they're on a religious quest so it's not going to get better: https://x.com/RobertFreundLaw/status/2006111090539687956

Re: 2025: The Year in LLMs

#27
post #22

Not in this review: Also the record year in intelligent systems aiding in and prompting human users into fatal self-harm. Will 2026 fare better?

Also essential self-fulfilment.

But that one doesn't make headlines ;)

Re: 2025: The Year in LLMs

#28
post #27
post #22

Not in this review: Also the record year in intelligent systems aiding in and prompting human users into fatal self-harm. Will 2026 fare better?

Also essential self-fulfilment. But that one doesn't make headlines ;)

Sure -- but that's fair game in engineering. I work on cars. If we kill people with safety faults I expect it to make more headlines than all the fun roadtrips.

What I find interesting with chat bots is that they're "web apps" so to speak, but with safety engineering aspects that type of developer is typically not exposed to or familiar with.

Re: 2025: The Year in LLMs

#29
post #23

Earlier quoted context omitted.

Why do people assume negative critique is ignorance?

People denied that bicycles could possibly balance even as others happily pedaled by. This is the same thing.

Bicycles don't balance, the human on the bicycle is the one doing the balancing.

Re: 2025: The Year in LLMs

#30

I'm curious how all of the progress will be seen if it does indeed result in mass unemployment (but not eradication) of professional software engineers.

I nearly added a section about that. I wanted to contrast the thing where many companies are reducing junior engineering hires with the thing where Cloudflare and Shopify are hiring 1,000+ interns. I ran out of time and hadn't figured out a good way to frame it though so I dropped it.
Post reply on HN