Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude Opus 4.7 Model Card

anthropic.com

Post reply on HN
Print view View original

41–50 of 88 posts

Re: Claude Opus 4.7 Model Card

#41

Post by daemonologist »

jzig wrote: post #34
bachittle wrote: post #25

So Opus 4.7 is measurably worse at long-context retrieval compared to Opus 4.6. Opus 4.6 scores 91.9% and Opus 4.7 scores 59.2%. At least they're transparent about the model degradation. They traded long-context retrieval for better software engineering and math scores.

At what point along the 1M window does context become "long" enough that this degradation occurs?

The benchmark GP mentioned is measuring at 128k-256k context (there's another at 524k-1024k, where 4.6 scored 78.3% and 4.7 scored 32.2%).

The longer the context the worse the performance; there isn't really a qualitative step change in capability (if there is imo it happens at like 8k-16k tokens, much sooner than is relevant for multi-turn coding tasks - see e.g. this old benchmark https://github.com/adobe-research/NoLiMa ).

Re: Claude Opus 4.7 Model Card

#42

Post by malcolmgreaves »

rogerrogerr wrote: post #21
Philpax wrote: post #16

Earlier quoted context omitted.

Both. There's the risk of them instructing a user on how to produce a known formulation (the Anarchist Cookbook solution, as you say), which is irritating but not that problematic. The bigger issue is that they are potentially capable of producing novel formulations capable of producing harm, and guiding someone through this process. That is, consider a world in which someone with malicious desires has access to a mo…

The world has been blessed by two connected things: 1. Smart people have economic opportunities that align them away from being evil 2. People who are evil tend not to be smart. We're breaking both of these assumptions.

That’s not quite true. Take a look at all the billionaires destroying society. Being evil is the surest way to get to get rich. In fact it’s the only way to amass that level of capital: there’s no ethical billionaire.

Re: Claude Opus 4.7 Model Card

#43

Post by kube-system »

> Chemical and biological weapons threat model 2 (CB-2): Novel chemical/biological weapons production capabilities. A model has CB-2 capabilities if it has the ability to significantly help threat actors (for example, moderately resourced expert-backed teams) create/obtain and deploy chemical and/or biological weapons with potential for catastrophic damages far beyond those of past catastrophes such as COVID-19.

That's an interesting choice of benchmark for measuring the risk of "Chemical and biological weapons"

Re: Claude Opus 4.7 Model Card

#45

Post by Someone1234 »

RobinL wrote: post #33
freedomben wrote: post #31

Earlier quoted context omitted.

Agreed, I appreciate the transparency (and Anthropic isn't normally very transparent). It's also great to know because I will change how I approach long contexts knowing it struggles more with them.

Could this be because they've found the 1m context uneconomical (ie costs too much to serve, or burns through users quota too quickly causing complaints), and so they're no longer targeting it as a goal

Opus 4.7 is also worse at 256K context. Go look at page 195 and page 196. It is across the board regression, not just 1M context.

Re: Claude Opus 4.7 Model Card

#46

Post by jmward01 »

dkhenry wrote: post #26
make3 wrote: post #18

Earlier quoted context omitted.

absolutely not on par you're smoking

You make a compelling argument, but thankfully I have data to back up my anecdotal experience This comparison shows them neck and neck https://benchlm.ai/compare/claude-sonnet-4-5-vs-gemma-4-31b As Does this one https://llm-stats.com/models/compare/claude-sonnet-4-6-vs-ge... And the pelican benchmark even shows them pretty close https://simonwillison.net/2026/Apr/2/gemma-4/ https://simonwillison.net/2025/Sep/29/claud…

I think one area I find hard to get around is context length. Everything self hosted is so limited on length that it is marginal to use. Additionally I think that the tools (like claude code) are clearly in the training mix for Anthropic's models so they seem to get a boost over other models pushed into that environment. That being said, open source and local inference is -really- good and only going to get better. There is no doubt that the current frontier biz model is not sustainable.

Re: Claude Opus 4.7 Model Card

#47

Post by ModernMech »

aliljet wrote: post #11

Have they effectively communicated what a 20x or 10x Claude subscription actually means? And with Claude 4.7 increasing usage by 1.35x does that mean a 20x plan is now really a 13x plan (no token increase on the subscription) or a 27x plan (more tokens given to compensate for more computer cost) relative to Claude Opus 4.6?

Feels like buying toilet paper.

Re: Claude Opus 4.7 Model Card

#49

Post by mikek »

malcolmgreaves wrote: post #42
rogerrogerr wrote: post #21

Earlier quoted context omitted.

The world has been blessed by two connected things: 1. Smart people have economic opportunities that align them away from being evil 2. People who are evil tend not to be smart. We're breaking both of these assumptions.

That’s not quite true. Take a look at all the billionaires destroying society. Being evil is the surest way to get to get rich. In fact it’s the only way to amass that level of capital: there’s no ethical billionaire.

This feels like a wild overgeneralization. People can become rich without resorting to evil methods, especially now with global markets and software. Case in point: Minecraft was wildly successful, and now Notch is a billionaire.

Re: Claude Opus 4.7 Model Card

#50

Post by Aboutplants »

kube-system wrote: post #43

> Chemical and biological weapons threat model 2 (CB-2): Novel chemical/biological weapons production capabilities. A model has CB-2 capabilities if it has the ability to significantly help threat actors (for example, moderately resourced expert-backed teams) create/obtain and deploy chemical and/or biological weapons with potential for catastrophic damages far beyond those of past catastrophes such as COVID-19. That…

Gotta prime those Government fears!
Post reply on HN