Live data from Hacker News

Elevated Errors for Opus 5

status.claude.com

91–96 of 96 posts

Re: Elevated Errors for Opus 5

#91

Maybe optimize the harness for less turns and less tokens to deliver real value as opposed to the turn taking token hungry so you can less load on your servers, oh, right, your entire bottom line is tokens.

Then why are fable form anthropic and the 5.6 sol line from openai so much more token efficient than other models? I really don't get this take at all - they're supply constrained right now, and there's literally no economic incentive to make each response take more tokens for the same output when we're in a market as intensely defined by induced demand/jevons paradox as this one. People are hitting their limits. If…

I said optimize your harness, not your model. My comment was with regards to Claude Code. There are lots of ways to achieve the same task with less turns with different engineered harnesses around more efficient models.

Look at features they release, such as Dynamic Workflows, that spin up 100+ sub agents then reconcile the result.

Does that make sense now?

Re: Elevated Errors for Opus 5

#92

Earlier quoted context omitted.

Then why are fable form anthropic and the 5.6 sol line from openai so much more token efficient than other models? I really don't get this take at all - they're supply constrained right now, and there's literally no economic incentive to make each response take more tokens for the same output when we're in a market as intensely defined by induced demand/jevons paradox as this one. People are hitting their limits. If…

I said optimize your harness, not your model. My comment was with regards to Claude Code. There are lots of ways to achieve the same task with less turns with different engineered harnesses around more efficient models. Look at features they release, such as Dynamic Workflows, that spin up 100+ sub agents then reconcile the result. Does that make sense now?

Yes? Dynamic workflows are incredibly powerful - especially for massive rote migrations. They're also particularly nice when you want to stretch an expensive model like fable and you can have it orchestrate a bunch of sonnet agents or whatever and get decent results without having every token burned be a fable token. For my usage style I find the best thing to be about dynamic workflows to be a sort of context management win. The orchestrator agent, if it was implementing everything, would end up deep into its context window where performance degrades steeply, and if you ran into issues early on the session you'd have to be concerned about whether whatever reasoning traces are in context are poisoning your later outputs, while if you're using subagents once you steer the model whatever is doing implementation is starting from fresh context with a new prompt so you aren't forced to kill and restart your session all the time. The way workflows are implemented - scripting with clearly defined stages also mean that the workflow will terminate eventually instead of running forever.

Now with that said, opensi's ultra mode is absolute trash - they should just have stolen Claude code's implementation - and there are clearly modes like max reasoning where they'll burn double the tokens to get another 10th of a percent performance to win benchmarks, which you should basically never be using. They're not making those versions at the expense of more efficient reasoning levels though and I don't mind that they exist (as long as they don't get made the default mode - openai - fix your ultra mode already).

Re: Elevated Errors for Opus 5

#93

Earlier quoted context omitted.

I mean, it's a near daily experience for me that Claude tries to 'sudo pacman -S' some dependency multiple times before giving up and admitting that it's fundamentally impossible for it to run that command in the first place. I could accomplish a lot more with those tokens if it just asked for the package to be installed.

Anthropic is not fully in control of the model.

but they are in control of the harness and could pay closer attention to where tokens leak on suboptimal turns there

Re: Elevated Errors for Opus 5

#94

Earlier quoted context omitted.

Anthropic is not fully in control of the model.

but they are in control of the harness and could pay closer attention to where tokens leak on suboptimal turns there

What makes you think they aren't doing that?

You don't want to ban the model from running sudo. I have Claude working in a VM where it has (and needs) free rein, including sudo.

Re: Elevated Errors for Opus 5

#95
post #84
post #41

Earlier quoted context omitted.

Interesting, but also wholly incomplete without knowing how effective the respective models are and how much people are actually using them.

True, and the pricing plus token efficiency seem to suggest that gpt-5.6 is much more efficient. But hard to know since neither lab publishes that info and it’s a bit of an apples and oranges comparison.

Isn't both of those, potentially, just consequences of OAI having more spare compute?

Re: Elevated Errors for Opus 5

#96
post #9

What happens one day when there is a significant outage of Claude or Codex and reliance on these tools as SaaS services is so great that it start to impact productivity and work? Will we just pack up our tools and go home?

Just like when there's an internet outage. Go for a walk, talk to your friends. Live a little :)
Post reply on HN