Model HLE w/tools GDPval-AA v2
Claude Fable 5.1 65.0 1853
GPT-5.6 Sol 64.5 ~1711-1730
GLM-5.3 62.5 1769
DeepSeek V4 Pro 60.0 1590
Kimi K3 59.8 1682
Qwen3.8-Max 56.2 1739Claude Fable 5.1 and Claude Mythos 5.1
431–440 of 1001 posts
Re: Claude Fable 5.1 and Claude Mythos 5.1
#432(I work at Anthropic) Beyond all the benchmarks, I think Fable 5.1 is a big improvement in writing style. It sounds a lot less stereotypically like other Claude models, has (imho) a much more natural style, and responds to my style instructions more reliably. More work to be done (and we will!) but reading better prose makes me so much happier. Another point I expect not to get much attention until it all happens at…
Does it fix my favorite pet peeve, the overuse of the wrong meaning of "fail closed"? "Fail open" usually refers to a fuse that opens and kills power, meaning the system is inert and safe on failure. "Fail closed" is the opposite -- system has power and is live. Computer security people have appropriated the term but use it for the completely opposite meaning. When your work straddles electrical engineering and compu…
I understand fail closed to mean, be secure when in failure. And fail open to be continue to operate during a failure. A door that fails closed would not let anyone in; one that fails open lets everyone in.
But I can see how these are not the mutually exclusive definition the labels imply, especially if you apply the concept to entities that aren't doors or otherwise have explicit open/closed states. It's probably best to just be specific in those cases.
Similarly, open loop vs closed loop seems to trip people up enough that I no longer use it. But the confusion is understandable since "closed loop" being "has a feedback loop" sounds backwards. Which, is the same way it's being used in your fuse example; a "closed" fuse closes the circuit making it live. But it's still backwards from the colloquial usage, even if it's correct in that context.
Re: Claude Fable 5.1 and Claude Mythos 5.1
#433(I work at Anthropic) Beyond all the benchmarks, I think Fable 5.1 is a big improvement in writing style. It sounds a lot less stereotypically like other Claude models, has (imho) a much more natural style, and responds to my style instructions more reliably. More work to be done (and we will!) but reading better prose makes me so much happier. Another point I expect not to get much attention until it all happens at…
So I believe that, at least in the short run, we might be seeing breakthroughs in hard open problems or in low hanging problems which are not that interesting to spend time on.
I may be wrong, if some research labs have private contracted access to the models
Re: Claude Fable 5.1 and Claude Mythos 5.1
#434(I work at Anthropic) Beyond all the benchmarks, I think Fable 5.1 is a big improvement in writing style. It sounds a lot less stereotypically like other Claude models, has (imho) a much more natural style, and responds to my style instructions more reliably. More work to be done (and we will!) but reading better prose makes me so much happier. Another point I expect not to get much attention until it all happens at…
I have a pet theory that the Opus prose style/smell we all have grown weary of is due at least in part to the models writing more for themselves and each other than for humans. They're packing lots of signal into fewer words and they don't care if it sounds cringe because it works better as glue in long-running tasks. I'm also thinking of the 2017 novel "Void Star" where AIs who operate everything have long since lef…
Re: Claude Fable 5.1 and Claude Mythos 5.1
#435Anyone ever seen the SouthPark episode making fun of Game of Thrones: A Song of Ass and Fire? Anthropic's announcements reminds me of "The Dragons Are Coming" running joke. What they have done: * Nerfed Fable, as many of noted it's useless * Leverage Mythos as a marketing strategy, claiming its too good to release * Removed thought traces, one of the only useful things to make sure your prompts are working correctly…
my view is we had a leap over the last fe years and it's tapering off.
this is fine, but for the IPOs
Re: Claude Fable 5.1 and Claude Mythos 5.1
#436Earlier quoted context omitted.
I just can't stand how often Claude says something like "And the honest part? It's..." Like, were the other parts not honest? I don't understand how Anthropic let it get like this, it's been such a clear regression
Sometimes Opus 5 (high/xhigh) feels like I'm dealing with the programmer equivalent of Zeno of Elea. Every time, without fail, it would get me 90% of the way there and then leave a small note, exception, or deferral. When instructed to address that, Opus would somehow take nearly the same amount of time as the first 90%. And then it would finish with yet another deferral . Repeat ad infinitum. You can sometimes get a…
Re: Claude Fable 5.1 and Claude Mythos 5.1
#437(I work at Anthropic) Beyond all the benchmarks, I think Fable 5.1 is a big improvement in writing style. It sounds a lot less stereotypically like other Claude models, has (imho) a much more natural style, and responds to my style instructions more reliably. More work to be done (and we will!) but reading better prose makes me so much happier. Another point I expect not to get much attention until it all happens at…
As someone working in science, this belief confuses me. How (by what means) do you think Fable 5.1 will be able to make further progress in scientific domains? The problem with science is that there is no agentic harness. The agent can't test things. At best it can hallucinate something and ask if that hallucination "makes sense", but this doesn't work in science.
Re: Claude Fable 5.1 and Claude Mythos 5.1
#438Earlier quoted context omitted.
As someone working in science, this belief confuses me. How (by what means) do you think Fable 5.1 will be able to make further progress in scientific domains? The problem with science is that there is no agentic harness. The agent can't test things. At best it can hallucinate something and ask if that hallucination "makes sense", but this doesn't work in science.
Great news, then! TFA: "Last week, we previewed the Model Hardware Standard, which allows Claude to directly and safely operate laboratory equipment."
However I think this area has so much decoupled from industry and solid research institutions that they might not notice at all (beyond their use of AI-generated slop to augment the slop they already produce)...
Re: Claude Fable 5.1 and Claude Mythos 5.1
#439Earlier quoted context omitted.
To be fair, I assume they want to hide that not from their customers, but adversaries who use the way Claude models think and reason to refine their own models.
I don't really want the models I use learning from Claude at this point. Open weight models of similar scale are available now too, so I expect this "distillation"/"stealing" chatter to wind down.
[0] not technically distillation. https://thomasdullien.github.io/posts/2026-06-15-rl-economic...
Re: Claude Fable 5.1 and Claude Mythos 5.1
#440"Price. Fable 5.1 will cost an estimated 25% less than Fable 5 for typical workloads, wherever usage is billed by token. This is because we’re reducing our pricing on cache reads (where the model reads inputs that have already been processed and stored). For highly agentic work, the savings will often be much larger—up to approximately 45%." Glad to see this!