Live data from Hacker News

The last six months in LLMs in five minutes

simonwillison.net

71–80 of 631 posts

Re: The last six months in LLMs in five minutes

#71
post #57

I'm curious how the 6 months have looked from a non-programmer's perspective. What kind of co-working tools and similar optimizations have people from other fields experienced?

My day job is not in the tech industry. I am an editor. Literally nothing has changed for me in the last four years.

Re: The last six months in LLMs in five minutes

#72

I wonder how much the 'inflection point' is a thing vs marketing. I'm sure the models got somewhat better, but even now when I'm trying to 'vibe code' a game with the latest models (combination of Codex w/ gpt5.5 and gpt5.3-codex), they really do struggle. They definitely get something barebones up and running, but it's far from a fully fledged application.

Paradox - you can get multiple inflection points even as systems start to have dimishing marginal returns in core capability, I think this is due to 'threshold crossing' where something 'becomes good enough for a specific purpose' - it just unlocks capabilities. 'Nail Guns' used to be heavy, required heavy power cords, they were extremely expensive. When they got lighter, cheaper, battery pack ... at some point, they…

[dead]

Re: The last six months in LLMs in five minutes

#76
post #41

If you're a vulnerability researcher or a security person generally, there's a big inflection point from Spring of this year.

Can you be more specific?

The Claude Mythos / Project Glasswing thing is real: https://www.anthropic.com/glasswing

I met a few people at PyCon this week who have been part of Glasswing (they're just starting to be allowed to talk about it) and it really does drive down the cost of finding vulnerabilities.

I've been collecting notes on that here: https://simonwillison.net/tags/ai-security-research/

Re: The last six months in LLMs in five minutes

#77
post #41

If you're a vulnerability researcher or a security person generally, there's a big inflection point from Spring of this year.

Can you be more specific?

Not op but just look at HN posts in the last couple weeks: supply chain worms, zero-day LPEs for all OSes seemingly every other day, researchers on X and here openly saying they’ve got more valid findings than they know what to do with

Re: The last six months in LLMs in five minutes

#78
post #50
post #44

Earlier quoted context omitted.

How do you justify your salary given that you're just using a tool that any of us could use for $20 an hour in your role?

Because the tool will happily give you a "solution" that kinda works for a few inputs. It will happily correct itself when you give it more incorrect tests. It will almost never converge on the general solution that will pass tests you haven't given it yet. This is why AI is sooo good at Javascript and related slop. A solution that "kinda works" is good enough 9 times out of 10 and if some tests fail well ... YOLO an…

To be fair, take away a human's paren highlighting and see how well they do.

Re: The last six months in LLMs in five minutes

#79
post #44

Earlier quoted context omitted.

I remember this very clearly myself. Before opus 4.5, I was doing a lot of hand holding and was coding a lot myself, but I have not written code since that day more or less. I did write some stuff myself just to learn how the enigma encryption machine worked, so wrote myself to learn. But professionally, I stopped coding in November.

How do you justify your salary given that you're just using a tool that any of us could use for $20 an hour in your role?

They're using a tool that anyone can use for $20 an hour, sure. But that's not what they're "just" doing. This is what is so insane about non-technical people talking about code - writing the actual syntax is not really the hard part.

What you're saying is like "how do you justify your salary as a NASA engineer when anyone can use Simulink and generate the code?"

It is extremely ignorant.

Re: The last six months in LLMs in five minutes

#80

what are your thoughts on Software engineer replacement. My team has already seen big reductions. Q/A team is gone. Software Engineer reduced by a third. Scared for the future

Ditching the QA team when the single highest challenge is verifying that vibe-coded systems do what they're meant to is extraordinarily short-sighted.

Personally, the more time I spend working with coding agents the least worried I am for my career. Getting the best results out of them is really hard. They amplify existing skills and experience, so the more experience you have the better.

Post reply on HN