Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude Sonnet 4.6

anthropic.com

Post reply on HN
Print view View original

841–850 of 1001 posts

Re: Claude Sonnet 4.6

#841

Post by raincole »

csmpltn wrote: post #498
wat10000 wrote: post #472

Earlier quoted context omitted.

It's very simple: prompt injection is a completely unsolved problem. As things currently stand, the only fix is to avoid the lethal trifecta. Unfortunately, people really, really want to do things involving the lethal trifecta. They want to be able to give a bot control over a computer with the ability to read and send emails on their behalf. They want it to be able to browse the web for research while helping you wr…

> «It's very simple: prompt injection is a completely unsolved problem. As things currently stand, the only fix is to avoid the lethal trifecta.» True, but we can easily validate that regardless of what’s happening inside the conversation - things like «rm -rf» aren’t being executed.

Congrats, you just solved halting problem.

Re: Claude Sonnet 4.6

#842

Post by bakugo »

ManlyBread wrote: post #448

Still fails the car wash question, I took the prompt from the title of this thread: https://news.ycombinator.com/item?id=47031580 The answer was "Walk! It would be a bit counterproductive to drive a dirty car 50 meters just to get it washed — you'd barely move before arriving. Walking takes less than a minute, and you can simply drive it through the wash and walk back home afterward." I've tried several other variant…

Claude 3.5 Sonnet gets this right most of the time. A model from October 2024.

> Walking would be more environmentally friendly and makes more sense for such a short distance (50 meters is about 164 feet). However, if you're planning to use an automatic car wash, you'll need your car there anyway, so you should drive. If you're planning to hand wash your car, walking with your supplies would be the better choice.

This just reaffirms my belief that models are actively getting worse at handling certain niche use cases, like these "gotcha" questions that are seemingly simple at a glance but don't realistically make sense for a person to ask. Probably a result of lower quality training data or excessive focus on coding.

Re: Claude Sonnet 4.6

#843

Post by cube2222 »

jorl17 wrote: post #519

I ran the same test I ran on Opus 4.6: feeding it my whole personal collection of ~900 poems which spans ~16 years It is a far cry from Opus 4.6. Opus 4.6 was (is!) a giant leap, the largest since Gemini 2.5 pro. Didn't hallucinate anything and produced honestly mind-blowing analyses of the collection as a whole. It was a clear leap forward. Sonnet 4.6 feels like an evolution of whatever the previous models were doin…

This seems to agree with my own previous tests of Sonnet vs Opus (not on this version). If I give them a task with a large list of constraints ("do this, don't do this, make sure of this"), like 20-40, Sonnet will forget half of it, while Opus correctly applies all directives.

My intuition is this is just related to model size / its "working memory", and will likely neither be fixed by training Sonnet with Opus nor by steadily optimizing its agentic capabilities.

Re: Claude Sonnet 4.6

#844

Post by danielbln »

ge96 wrote: post #502
dpe82 wrote: post #10

It's wild that Sonnet 4.6 is roughly as capable as Opus 4.5 - at least according to Anthropic's benchmarks. It will be interesting to see if that's the case in real, practical, everyday use. The speed at which this stuff is improving is really remarkable; it feels like the breakneck pace of compute performance improvements of the 1990s.

I sent Opus a photo of NYC at night satellite view and it was describing "blue skies and cliffs/shore line"... mistral did it better, specific use case but yeah. OpenAI was just like "you can't submit a photo by URL". Was going to try Gemini but kept bringing up vertexai. This is with Langchain

I just sent Opus a NYC night satellite view and it described it just as expected. Seems like you have a tooling problem, not a model problem.

Re: Claude Sonnet 4.6

#845

Post by monkeydust »

The demise of saas has been overplayed imho. When companies buy software they are essentially buying something that solves a problem and the insurance that comes with that. Part of that means they get to pick up the phone and complain if something doesn't work and someone on the other end has to listen.

There is also a strong community aspect to software, someone asks for an enhancement others can benefit etc.

I just don't see a world where every corporation is building their own accounts, crm, hr software.

I do see one where they can much more quickly self-create within certain boundaries and this is where enterprises will differentiate in the near term.

Re: Claude Sonnet 4.6

#846

Post by ramraj07 »

rkomorn wrote: post #837
pickleRick243 wrote: post #836

Earlier quoted context omitted.

I always find these "anti-AI" AI believer takes fascinating. If true AGI (which you are describing) comes to pass, there will certainly be massive societal consequences, and I'm not saying there won't be any dangers. But the economics in the resulting post-scarcity regime will be so far removed from our current world that I doubt any of this economic analysis will be even close to the mark. I think the disconnect is…

> We're going to have Skynet or Star Trek Star Trek only got a good society after an awful war, so neither of these options are good.

Star Trek only got a good society after discovering FTL and existence of all manner of alien societies. And even after that Star Treks story motivations on why we turned good sound quite implausible given what we know about human nature and history. No effing way it will ever happen even if we discover aliens. Its just a wishful fever dream.

Re: Claude Sonnet 4.6

#847

Post by sneak »

monkeydust wrote: post #845

The demise of saas has been overplayed imho. When companies buy software they are essentially buying something that solves a problem and the insurance that comes with that. Part of that means they get to pick up the phone and complain if something doesn't work and someone on the other end has to listen. There is also a strong community aspect to software, someone asks for an enhancement others can benefit etc. I just…

It won’t be the demise of general purpose SaaS like CRM, though it may be the rise of ridiculously full featured f/oss alternatives.

However, niche stuff like vertical-specific CRUD apps that used to be able to charge a heavy SaaS premium simply because they could develop CRUD apps and UI faster than their customers are toast.

Re: Claude Sonnet 4.6

#848

Post by breppp »

josephg wrote: post #607
dakolli wrote: post #486

Earlier quoted context omitted.

Their goal is to monopolize labor for anything that has to do with i/o on a computer, which is way more than SWE. Its simple, this technology literally cannot create new jobs it simply can cause one engineer (or any worker whos job has to do with computer i/o) to do the work of 3, therefore allowing you to replace workers (and overwork the ones you keep). Companies don't need "more work" half the "features"/"products…

> Its also worth noting that if you can create a business with an LLM, so can everyone else. And sadly everyone has the same ideas Yeah, this is quite thought provoking. If computer code written by LLMs is a commodity, what new businesses does that enable? What can we do cheaply we couldn't do before? One obvious answer is we can make a lot more custom stuff . Like, why buy Windows and Office when I can just ask clau…

> One obvious answer is we can make a lot more custom stuff. Like, why buy Windows and Office when I can just ask claude to write me my own versions instead? Why run a commodity operating system on kiosks? We can make so many more one-off pieces of software

yes, it will enable a lot of custom one-off software but I think people are forgetting the advantages of multiple copied instances, which is what enabled software to be so successful in the first place.

Mass production of the same piece of software creates standards, every word processor uses the same format and displays it the same way.

Every date library you import will calculate two months from now the same way, therefore this is code you don't have to constantly double check in your debug sessions.

Re: Claude Sonnet 4.6

#849

Post by mrbungie »

sneak wrote: post #847
monkeydust wrote: post #845

The demise of saas has been overplayed imho. When companies buy software they are essentially buying something that solves a problem and the insurance that comes with that. Part of that means they get to pick up the phone and complain if something doesn't work and someone on the other end has to listen. There is also a strong community aspect to software, someone asks for an enhancement others can benefit etc. I just…

It won’t be the demise of general purpose SaaS like CRM, though it may be the rise of ridiculously full featured f/oss alternatives. However, niche stuff like vertical-specific CRUD apps that used to be able to charge a heavy SaaS premium simply because they could develop CRUD apps and UI faster than their customers are toast.

> full featured f/oss alternatives.

Assuming this comes from lower barriers of entry to software engineering skills at scale with LLMs, this is still begs the question: Who will pay for the tokens? One thing is giving away your free time for passion, other one is giving away money.

Maybe we'll see a future were people crowdsource projects supporting them directly via donations for tokens/LLM queries.

Re: Claude Sonnet 4.6

#850

Post by dana321 »

monkeydust wrote: post #845

The demise of saas has been overplayed imho. When companies buy software they are essentially buying something that solves a problem and the insurance that comes with that. Part of that means they get to pick up the phone and complain if something doesn't work and someone on the other end has to listen. There is also a strong community aspect to software, someone asks for an enhancement others can benefit etc. I just…

"Part of that means they get to pick up the phone and complain if something doesn't work and someone on the other end has to listen."

All over the internet on forums are stories of software that haven't fixed x bug, missing features and bugs that have been in software for years.

Post reply on HN