I was happily plodding away with it earlier when it threw this out in the middle of a response in Claude code: --- So — what did you actually see before you hit Ctrl-C? That's the信号 I'm most curious about, and it tells us what to --- That's the sort of behavior I'd expect from a one or two year old model quantized down to about 1 bit - right word, wrong language in a response. Google translate tells me that's Chinese…
Claude Opus 4.8
731–740 of 1001 posts
Re: Claude Opus 4.8
#732"Users will find Opus 4.8 to be a modest but tangible improvement on its predecessor." This is a refreshing attitude! I've also verified that you can now turn off adaptive thinking in the web UI, which is great. I've had a lot of problems with thinking not triggering and the model producing sub-par output. Glad we can finally turn it off. (I hope being able to turn off adaptive thinking is new, if I could have turned…
Re: Claude Opus 4.8
#733Re: Claude Opus 4.8
#734My fav coding benchmark for frontier models is to build a simple RTS game in one file (js/html/css). Claude Code with Opus 4.8 in ultracode mode nailed it, the best result so far: https://bsky.app/profile/senko.net/post/3mmwnrkwboc2v The prompt was: Create a simple but functional real time strategy (RTS) game similar to old WarCraft, StarCraft or Command & Conquer games. The player should be able to build buildings,…
Re: Claude Opus 4.8
#735Earlier quoted context omitted.
I won't be surprised if the next gen frontier models are the last. There's orders of magnitude of low hanging juice to squeeze out of smaller models. It is almost guaranteed that a 60-90B model can outperform current SOTA in coding tasks within 2-3 years (design not certain, probably unlikely). It is far less clear that a 1.2T model will be meaningfully better enough to justify training it. As far as reasoning is con…
There is endless returns to frontier intelligence, just because most people can't make use of it doesn't mean someone can't make a ton of money off of it. Most software engineers will just need cheap tokens. But things like physics and drug discovery have no foreseeable upper bound.
Throwing more intelligence at a problem doesn’t necessarily pan out financially otherwise we wouldn’t have single underemployed biology PhD.
Re: Claude Opus 4.8
#736Should I try 4.8? I am happy with 4.6. I am not happy with 4.7.
Re: Claude Opus 4.8
#737Re: Claude Opus 4.8
#738Earlier quoted context omitted.
why are the models the same price? https://platform.claude.com/docs/en/about-claude/pricing ``` Model Base Input Tokens 5m Cache Writes 1h Cache Writes Cache Hits & Refreshes Output Tokens Claude Opus 4.8 $5 / MTok $6.25 / MTok $10 / MTok $0.50 / MTok $25 / MTok Claude Opus 4.7 $5 / MTok $6.25 / MTok $10 / MTok $0.50 / MTok $25 / MTok Claude Opus 4.6 $5 / MTok $6.25 / MTok $10 / MTok $0.50 / MTok $25 / MTok Claude Op…
Same price on a token basis, but usually steadily decreasing on a task basis
Re: Claude Opus 4.8
#739Re: Claude Opus 4.8
#740Earlier quoted context omitted.
IME the most noticeable performance boosts are in complex multi-agent workflows. EX. You call an orchestration agent and define an implementation plan with the help of a number of sub agents planning out different features. You and the lead agent review all of the plans and send them off to a set of agents that write tests which get send back to the orchestrator then passed along with the plan to a set of coding agen…
i dont think theres anything particularly special about new models for that though. thats a harness improvement