Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Project Glasswing: Securing critical software for the AI era

anthropic.com

Post reply on HN
Print view View original

811–820 of 921 posts

Re: Project Glasswing: Securing critical software for the AI era

#811

Post by GoatInGrey »

mlsu wrote: post #792
KronisLV wrote: post #675

Earlier quoted context omitted.

> Every time I mention this I feel like there’s a bunch of factors for why it will never be the same for many folks, from the models and harnesses, to the domains and existing tests/tooling. I feel bad for the people for whom it doesn’t work, but Claude Opus has written most of my code in 2026 so far. I had to build some tools around linting entire projects and most of my tokens are probably referencing existing stuf…

It’s because the models response is conditioned on the prompt. They are as intelligent as the person using them In some sense it’s a lot like a google search. There’s this big box of knowledge and you are choosing tokens to pluck out of it. The quality of the tokens depends on how intelligent you are.

The irony here is that even if one is extracting legitimate value from LLMs because they are that much smarter than their peers, the process of using LLMs to perform all of their skilled labor makes them less intelligent.

Re: Project Glasswing: Securing critical software for the AI era

#812

Post by nearbuy »

gchadwick wrote: post #776
ofjcihen wrote: post #508

I’m sure the new model is a step above the old one but I can’t be the only person who’s getting tired of hearing about how every new iteration is going to spell doom/be a paradigm shift/change the entire tech industry etc. I would honestly go so far as to say the overhype is detrimental to actual measured adoption.

Remember OpenAI decided GPT 2 was far too dangerous to unleash upon the world when they first trained it!

That's an editorialized headline. What they actually wrote was that it could be used to "generate misleading news articles, impersonate others online, automate the production of abusive or faked content to post on social media, [or] automate the production of spam/phishing content" and that they are aware other researchers have the ability to reproduce and open source their results, but this would give the community some time to decide how to proceed.

They were correct.

Re: Project Glasswing: Securing critical software for the AI era

#813

Post by GoatInGrey »

WithinReason wrote: post #670
ofjcihen wrote: post #594

Earlier quoted context omitted.

That feels like a very complex way of looking at it. Another way would be to say “potentially profit seeking companies have an incentive to oversell products even if they’re good”.

Is Anthropic lying about model capabilities? If not, where is the overselling?

March 2025, Anthropic was claiming that 90% of code would be written by LLMs in three to six months, and "essentially all" code within twelve months. This was one week after closing a Series E round for $3.5 billion. When they began working on their Series F round for $13 billion. You shouldn't need more than that to understand what's going on here.

The Claude Code leak revealed that Anthropic runs Claude-operated bots on the internet. One should be very cautious in getting swept up in the fund-raising process if they are not seeing first-hand the fruition of all of the flattering claims being presented by strangers on the internet.

Re: Project Glasswing: Securing critical software for the AI era

#814

Post by dyauspitr »

conradkay wrote: post #149
tptacek wrote: post #134

Earlier quoted context omitted.

That's exactly not what they're doing. They aren't creating operating system vulnerabilities. They're telling you about ones that already existed.

Well, in a slightly indirect manner. Claude is writing a ton of code, and therefore creating a lot of security vulnerabilities.

If it’s very good at finding security vulnerabilities, I would assume that the code it generates is much more hardened than anything your average developer can put out.

Re: Project Glasswing: Securing critical software for the AI era

#816

Post by akmiller »

ofjcihen wrote: post #508

I’m sure the new model is a step above the old one but I can’t be the only person who’s getting tired of hearing about how every new iteration is going to spell doom/be a paradigm shift/change the entire tech industry etc. I would honestly go so far as to say the overhype is detrimental to actual measured adoption.

Hasn't almost every model created a paradigm shift lately? Maybe it's you who has moved the needle on what a paradigm shift means?

Re: Project Glasswing: Securing critical software for the AI era

#817

Post by qnleigh »

airstrike wrote: post #190
dakolli wrote: post #112

Earlier quoted context omitted.

Typical Dario marketing BS to get everyone thinking Anthropic is on the verge of AGI and massaging the narrative that regular people can't be trusted with it.

I mean it's so obvious at this point and yet everyone falls from it every month. There's an IPO coming, everyone.

This is buried in section 7.6 of a 244 page document. Amodei probably hasn't even read it.

Re: Project Glasswing: Securing critical software for the AI era

#819

Post by aagha »

ofjcihen wrote: post #508

I’m sure the new model is a step above the old one but I can’t be the only person who’s getting tired of hearing about how every new iteration is going to spell doom/be a paradigm shift/change the entire tech industry etc. I would honestly go so far as to say the overhype is detrimental to actual measured adoption.

https://news.ycombinator.com/item?id=47682262
Post reply on HN