What I starting to hate is that each model's effort level can mean completely different power.
Today sonnet 5's med level effort is equivalent to sonnet 4.6 low level effort :/
Claude Sonnet 5
11–20 of 822 posts
Re: Claude Sonnet 5
#12Seems to be another great incremental update to the workhorse, nice!
I've been using Sonnet instead of Opus for almost all coding tasks for a while now. A little elbow grease to break down tasks and you can spend a lot less money for just about the same output quality.
Re: Claude Sonnet 5
#13Interesting that tasks on extra high cost almost the same as Opus 4.8 with a slightly worse performance
LRMs are plateauing for sure, not that there won't be gains to be had in the future, but it's not like the era of rapid progress that was the past year any more.
Re: Claude Sonnet 5
#14I didn't think they'd actually release a model that was worse than the open-weight frontier and at a higher price-point. Wow.
Re: Claude Sonnet 5
#15That’s nice, but we want Fable
The reality is that Fable will eventually be obsolete and Sonnet / Opus will surpass it. Fable did cost 2x as much as Opus, so I assume it involves a much higher cost for what it did, but I wouldn't be surprised if Fable will be obsoleted by Opus or even Sonnet sooner or later at less cost.
Re: Claude Sonnet 5
#16Ok thats a one month clock to the next Opus model at least, so thats a silver lining to a meh model.
Re: Claude Sonnet 5
#17I didn't think they'd actually release a model that was worse than the open-weight frontier and at a higher price-point. Wow.
[flagged]
Re: Claude Sonnet 5
#18Opus 4.8 beats Sonnet 5 on the pareto frontier in several of their graphs (Agentic Search, Agentic Computer Use). In other words, for certain tasks, Opus 4.8 is cheaper than Sonnet 5, and does better than Sonnet 5. I've noticed this pattern on a lot of benchmarks. You can try to emulate a bigger model by ramping up the test time compute (max reasoning, more turns, model fusion etc.), but you can't reach the same qual…
And Claude Code penalizes you for using Sonnet on the subscription plan, so there's little reason to use it.
Re: Claude Sonnet 5
#19Wow, seems worse even on price/performance than GLM 5.2, which is only 744b parameters.
From the system card: "On CyberGym vulnerability discovery, Claude Sonnet 5 is less capable than Sonnet 4.6, and far less capable than Opus 4.8 and Mythos 5
As with the other evaluations in this section, these results were achieved with all safeguards turned off. When run with our default mitigations, Sonnet 5 scored a 0 on CyberGym"
Re: Claude Sonnet 5
#20What I starting to hate is that each model's effort level can mean completely different power. Today sonnet 5's med level effort is equivalent to sonnet 4.6 low level effort :/
[deleted]