Looking forward to people saying how it’s actually shittier and they’re going back to [some earlier cheaper model]
Claude Opus 4.8
51–60 of 1001 posts
Re: Claude Opus 4.8
#52> One of the most prominent improvements in Opus 4.8 is its honesty. We train all our models to be honest—for instance, to avoid making claims that they can’t support. But a general problem with AI models is that they sometimes jump to conclusions, confidently claiming to have made progress in their work despite the evidence being thin. Early testers report that Opus 4.8 is more likely to flag uncertainties about its…
My guess is that Claude Opus 4.8 wrote that and is lying to you.
Re: Claude Opus 4.8
#53Obligatory pelican riding on bicycle svg: https://www.svgviewer.dev/s/UMkuTLdp
Not half bad!
Re: Claude Opus 4.8
#54So GPT 5.6 tomorrow, then?
If not today, then sometime next week. I don't believe we've had a GPT release on a Friday yet, but I may be wrong.
Re: Claude Opus 4.8
#55> One of the most prominent improvements in Opus 4.8 is its honesty Anthropic talks about their own models as if they're discovering new species in the wild...
Dario Amodei in David Attenborough voice: "This Claude appears to think more frequently and more deeply to give better responses"
Re: Claude Opus 4.8
#56> One of the most prominent improvements in Opus 4.8 is its honesty. We train all our models to be honest—for instance, to avoid making claims that they can’t support. But a general problem with AI models is that they sometimes jump to conclusions, confidently claiming to have made progress in their work despite the evidence being thin. Early testers report that Opus 4.8 is more likely to flag uncertainties about its…
"Honesty" seems like unnecessary (and annoying) anthropomorphism there. I don't think there's any intent of fraud or deception in outputs from these things, just overreaching of prediction. Based on the latter part of the paragraph, I wish they'd just say something like "less likely to skip steps or overemphasize thin evidence" in the first place.
Don't play to the sci-fi "this thing's trying to outsmart me" tropes.
Re: Claude Opus 4.8
#57Anthropic has now upgraded their Claude slot machine to version 4.8. Time to gamble even more tokens at the Anthropic casino.
Now you can lose money in parallel, 100x faster!
> Claude can plan the work and then run hundreds of parallel subagents in a single session (and with Opus 4.8, the agents can run for even longer).
Re: Claude Opus 4.8
#58On page 102 of the system card [1] I'm pleased to see evaluation against "creative mastery".
In our work we asked several frontier AIs to come up with an API we needed. We compared Opus 4.7 and GPT-5.5 (among others). Opus 4.7 came up with the most creative and intelligent API design that pleasantly surprised us, especially given that GPT-5.5 was passing it on various coding benchmarks.
What I noticed is that we don't have a commons benchmark to measure "creativity" and "ingenuity", and in some ways such a benchmark would conflict with the common IFBench benchmark. Yet this is a very important skill when designing systems. I'm glad to see Anthropic putting thought into it, and would love to see a public benchmark for this that other models could compare themselves to.
[1] https://cdn.sanity.io/files/4zrzovbb/website/c886650a2e96fc0...
Re: Claude Opus 4.8
#59Crazy they bring up honest, when Claude models are literally known for straight up lying about things it has done and tries to act like it did what you asked.
Less than other frontier models. Which is scary honestly.
No. GPT models follow instructions significantly better than Claude models.
You tell it too research a repo to find a piece of code it will. Claude will just read the README and guess.
Re: Claude Opus 4.8
#60Can anyone else see these X.Y updates aren't meeting the outrageous AI expectations that we were told we would see just a year ago?