Live data from Hacker News

The last six months in LLMs in five minutes

simonwillison.net

331–340 of 631 posts

Re: The last six months in LLMs in five minutes

#331

Earlier quoted context omitted.

It can look like that in certain conditions. The question is why are you so eager to give critique on unrelated work, appearing in a demo screencap, to someone who didn't produce it?

I don't know what you're talking about. His tool wraps Claude and breaks the TUI. What's so hard to understand? That's valid critique. What world have I woke up in today?

[deleted]

Re: The last six months in LLMs in five minutes

#332

Earlier quoted context omitted.

Out of curiosity - what harness did you use, and what model? And how are you prompting? In my mind prompting like: “You’re going to make frogger in javascript. I want a complete clone of functionality for level 1, with amazing 80s era pixel art sprites. I’m super lazy, so you’re going to have to test everything, right from the start. Pick a test harness, write the tests, including tests for having amazing graphics, g…

Sure give it a go, perhaps it will work better now with frontier models, I haven't tried it in a while (this was a year ago, things have improved since then). I'm not sure what tests for having amazing graphics, gameplay, input, UI, sounds, etc would look like, but it would be interesting to see the results!

okay hold my beer. both claude and codex running now.

EDIT: both agents took about 20 minutes. I used that exact prompt in a clean directory for each, and then said "deploy to netlify" - so a total of two prompts.

Codex: https://astounding-bavarois-27b5a2.netlify.app

Claude: http://strong-hotteok-91dfb0.netlify.app

Netlify is having trouble claiming the Claude project, so if you need a password it's "My-Drop-Site"

FYI, Claude rated itself 7.7/10 for fun, and Codex 98/100 during the fun test loop. As you'll see if you poke at them, Claude needs a physics bug fix round. But I think these both did about what I would have expected.

Re: The last six months in LLMs in five minutes

#333
We all have had the client from hell: they don't know what they want, they change their requirements all the time. Whenever they have a new half-baked idea, I need to scramble and re-design the architecture. They have no clue that a small change request has a big impact on the code.

Well... Now I can be that client. And let AI deal with my incomplete, always changing requirements. And get it done anyway.

Re: The last six months in LLMs in five minutes

#334

> The coding agents got really good It's since november 2025, the so called "inflection point", that I'm still wondering for who coding agents become "really good". All I observe they got better at tool call and answering questions about big codebases, especially if the question has a vague pattern to search, and they're superuseful for that! For generating production code even with a lot of steering and baby sitting…

The polarization comes from the very disparate coding experiences and output quality that different people find when using these tools. For example, I've had the opposite experience of yours, generating very high quality work using Claude (such as https://github.com/kstenerud/yoloai ). Just in dealing with all the bugs and idiosyncrasies in the technologies I'm using, the agent has been a godsend in discovering and c…

While reading this thread, I literally just caught an agent putting in the following CSS selector in a rule:

> .row > div > div, .alert

This is fairly simple CSS, not multi-threaded systems development. A bar low enough that you could trip over it. I catch this kind of stuff all the time (literally every run), but only because I read every line. Most of it wouldn't be the end of the world for any particular task, but would eventually result in a complete mess.

I think the people doing the heaviest breathing around the elimination of programmers either aren't very good at programming, or they're not paying close attention. Or they're hyping their book.

Re: The last six months in LLMs in five minutes

#335

The tooling has become so good though - the eco-system around the LLM. The models have become really good, yes - but it's definitely slowed in my opinion. The tooling is what really has become great - "harness" is probably the best word. When folk like Elon/Schmidt/Theil/etc. talk about singularities and industrial revolutions - it sounds extremely out of touch - or actually protective of the massive capex they've po…

Much of the recent improvement in models is in being trained specifically to make use of the tools the harnesses give them.

Re: The last six months in LLMs in five minutes

#336

Earlier quoted context omitted.

I think it's because both sides are talking about different things. If you go in expecting it is good enough to make developers obsolete today(reasonable impression to get from the way a lot of people hype it) you would be disappointed and after first couple of tries every few months you would probably not try it much with next generations. Reasonable if it's considered a dichotomy. But a lot of people excited about…

You're completely twisting what I said. I've never talked about people claiming it's not making developers obsolete. We are obviously extremely far from that. I'm talking about people who say it doesn't work to build basic features in their projects correctly. Just take a look at this comment on a different topic, which lists all the pre-requisite for those AI models to work well, from the perspective of someone who…

Maybe we come from different cultures and context is harder to grasp just in text so maybe for those reasons your response feels ruder than I hope it was intended to be.

I am sorry for not being clear in my response but I didn't intend to twist your words. I am not sure where I did so. My response was intended to be a more general remark on the kind of discourse on this topic I see and that I think both sides are right from the context they are looking in with and also why I think both sides come out of this discussion exhausted of the other. Not discounting presence of bad actors but generally I think there are most engaging in good faith like you are probably.

Coming specifically to respond your last response, I don't think one needs all of these prerequisites to get value out of LLMs. In fact LLMs have helped me untangle some very messy ball of muds on projects where we previously deemed it not worth the effort and basically carried some codebases as legacy. Now we can write enough tests to feel confidence and do a port against those tests all in a span of few days, which we found impressive.

Now having said all this, I think I understand your perspective a bit better on your original comment.

While it's a very versatile hammer, if it doesn't work for your use case that's all great. I just think that a bit more patience though with honing it maybe could help you find areas where it could work for you. If not, cheers!

Re: The last six months in LLMs in five minutes

#337
post #211

Earlier quoted context omitted.

It’s the opposite, non-creatives (if such roles even exist in those industries) should be worried. All those models offset technical skills, allowing to get from idea to implementation through a different route (which can be easier or harder depending on idea and model - good luck tweaking that pelican’s exact pose and movements to match your imagination precisely ). Nothing touches creativity, not even in the slight…

My mother has started watching 100% AI generated stories on YouTube. They are good enough to be entertaining even if they include random errors like messing up the main character’s name. The thing is the creative economy is all about people’s attention and pocketbooks, it doesn’t need to be great just good enough.

I think the elderly are particularly vulnerable. I also have at least one family member whose social media feed is 100% slop, they are blissfully unaware, and if you told them, they wouldn’t believe you.

Re: The last six months in LLMs in five minutes

#338

Earlier quoted context omitted.

Even more worrying are the implications for fakenews, propaganda, fraud, deception and mental health.

Maybe short term yes. But longer term people will finally put their guard up against deception that’s been around for decades.

No, it will just become like in the Soviet system - people will not believe anything anymore, and become disillusioned and just not care about anything other than their immediate surroundings. That's what being innundated with fake/exaggerated information results in. People don't know what to believe because they're seeing/hearing everything, and bits will be retained, but in general there will be a "this is too much, I can't keep up, who even knows, shrug".

Re: The last six months in LLMs in five minutes

#339

Earlier quoted context omitted.

Maybe short term yes. But longer term people will finally put their guard up against deception that’s been around for decades.

If they haven’t in the past I don’t see why they would now.

Next generation is healing already and staying away from social media, etc.

Re: The last six months in LLMs in five minutes

#340

> The coding agents got really good It's since november 2025, the so called "inflection point", that I'm still wondering for who coding agents become "really good". All I observe they got better at tool call and answering questions about big codebases, especially if the question has a vague pattern to search, and they're superuseful for that! For generating production code even with a lot of steering and baby sitting…

[dead]
Post reply on HN