Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude Opus 4.8

anthropic.com

Post reply on HN
Print view View original

91–100 of 1001 posts

Re: Claude Opus 4.8

#91

Post by simianwords »

malfist wrote: post #45
james_marks wrote: post #26

> One of the most prominent improvements in Opus 4.8 is its honesty. We train all our models to be honest—for instance, to avoid making claims that they can’t support. But a general problem with AI models is that they sometimes jump to conclusions, confidently claiming to have made progress in their work despite the evidence being thin. Early testers report that Opus 4.8 is more likely to flag uncertainties about its…

And yet, every release has claimed lower hallucination rates. But they persist.

False. Hallucination has meaningfully reduced.

Re: Claude Opus 4.8

#93

Post by sidrag22 »

deadbabe wrote: post #51

Looking forward to people saying how it’s actually shittier and they’re going back to [some earlier cheaper model]

Looking forward to not being able to even try it on pro because pressing enter will eat 50% of my 5 hour window.

Re: Claude Opus 4.8

#94

Post by rl3 »

vunderba wrote: post #17

I know it’s totally anecdotal, but I really hope 4.8 is a measurable improvement over the disappointment that was Opus 4.7. Mangling a very simple inversion-of-control abstraction (among many other issues) was one of the final straws that broke the proverbial camel’s back and I said “screw this” and put in a permanent override to force CC back to Opus 4.6 with the 1‑million‑token context. "model": "claude-opus-4-6[1M…

I lasted about a week before giving up on 4.7 and reverting to 4.6 myself. It introduced so many regressions it was nuts, then failed to troubleshoot the very regressions it introduced, leading to a vicious cycle that tended to compound itself.

Re: Claude Opus 4.8

#96

Post by [deleted] »

northern-lights wrote: post #23

> Not only that, but we plan to release a new class of model with even higher intelligence than Opus. As part of Project Glasswing, a small number of organizations are currently using Claude Mythos Preview for cybersecurity work. Models of this capability level require stronger cyber safeguards before they can be generally released. We’re making swift progress on developing these safeguards and expect to be able to b…

[deleted]

Re: Claude Opus 4.8

#97

Post by nickvec »

simonw wrote: post #73

I generated pelicans riding bicycles on both thinking level low and thinking level high: https://gist.github.com/simonw/68560eddb0b268a8417f80ceb7304... The high one is notably better - the bicycle frame is the correct shape, unlike thinking level low. For comparison, here's Opus 4.7: https://gist.github.com/simonw/afcb19addf3f38eb1996e1ebe749c...

Is the "opossum riding an e-scooter" benchmark in the works for Opus 4.8? ;)

Re: Claude Opus 4.8

#98

Post by MangoCoffee »

pbmango wrote: post #14

I can't help but think of Iphone updates since about 2018. The thinnest, fastest, longest battery life Iphone ever. It seems mostly the same and I probably won't be able to tell other than the name, but everyone buys it anyway. This is good psychology for the labs. When Buffett invested in Apple he loved citing how most people would rather give up their second car than their Iphone.

ChatGPT came out in 2022. Back then it was just a chatbot. Now we have AI agents. What matters is how we use them and how the agents get better. That’s what will move AI forward.

Re: Claude Opus 4.8

#99

Post by taytus »

NiloCK wrote: post #77

A rambling comment: I think this is the first time we've had a third minor version bump on a frontier Anthropic model. (I count the 0.5s as major here, because they've been issued non-sequentially and also corresponded to massive capability leaps, eg, Sonnet 3.5, Opus 4.5). So now the Opus 4.5 family has successors 4.6, 4.7, and 4.8, each posting fairly modest claimed gains. My own experience w/ 4.6 and 4.7 are that…

Incremental gains compounds.
Post reply on HN