Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

System Card: Claude Mythos Preview [pdf]

www-cdn.anthropic.com

Post reply on HN
Print view View original

241–250 of 687 posts

Re: System Card: Claude Mythos Preview [pdf]

#241

Post by boring-human »

sho_hn wrote: post #90
rafaelmn wrote: post #41

Earlier quoted context omitted.

GPT is shit at writing code. It's not dumb - extra high thinking is really good at catching stuff - but it's like letting a smart junior into your codebase - ignore all the conventions, surrounding context, just slop all over the place to get it working. Claude is just a level above in terms of editing code.

Very different experience for me. Codex 5.3+ on xhigh are the only models I've tried so far that write reasonably decent C++ (domains: desktop GUI, robotics, game engine dev, embedded stuff, general systems engineering-type codebases), and idiomatic code in languages not well-represented in training data, e.g. QML. One thing I like is explicitly that it knows better when to stop, instead of brute-forcing a solution b…

Same background as you, and same exact experience as you. Opus and Gemini have not come close to Codex for C++ work. I also run exclusively on xhigh. Its handling of complexity is unmatched.

At least until next week when Mythos and GPT 6 throw it all up in the air again.

Re: System Card: Claude Mythos Preview [pdf]

#242

Post by cedws »

therealdeal2020 wrote: post #227
cedws wrote: post #80

Earlier quoted context omitted.

More than killer AI I'm afraid of Anthropic/OpenAI going into full rent-seeking mode so that everyone working in tech is forced to fork out loads of money just to stay competitive on the market. These companies can also choose to give exclusive access to hand picked individuals and cut everyone else off and there would be nothing to stop them. This is already happening to some degree, GPT 5.3 Codex's security capabil…

but you are assuming that the magical wizards are the only ones who can create powerful AIs... mind you these people have been born just few decades ago. Their knowledge will be transferred and it will only take a few more decades until anyone can train powerful AIs ... you can only sit on tech for so long before everyone knows how to do it

It's not a matter of knowledge, it's a matter of resources. It takes billions of dollars of hardware to train a SOTA LLM and it's increasing all the time. You cannot possibly hope to compete as an independent or small startup.

Re: System Card: Claude Mythos Preview [pdf]

#243

Post by tempest_ »

sleigh-bells wrote: post #62
influx wrote: post #18

At what point do these companies stop releasing models and just use them to bootstrap AGI for themselves?

Weird how Claude Code itself is still so buggy though (though I get they don't necessarily care)

It isnt that weird. Just look at the gemini-cli repo. Its a gong show. The issue is that LLMs can be wrong sometimes sure but more that all the existing SDL were never meant to iterate this quickly.

If the system (code base in this case) is changing rapidly it increases the probability that any given change will interact poorly with any other given change. No single person in those code bases can have a working understanding of them because they change so quickly. Thus when someone LGTM the PR was the LLM generated they likely do not have a great understanding of the impact it is going to have.

Re: System Card: Claude Mythos Preview [pdf]

#244

Post by levocardia »

swalsh wrote: post #223
ru552 wrote: post #26

Earlier quoted context omitted.

There's speculation that next Tuesday will be a big day for OpenAI and possibly GPT 6. Anthropic showed their hand today.

My understanding is GPT 6 works via synaptic space reasoning... which I find terrifying. I hope if true, OpenAI does some safety testing on that, beyond what they normally do.

Oh you mean literally the thing in AI2027 that gets everyone killed? Wonderful.

Re: System Card: Claude Mythos Preview [pdf]

#246

Post by ninjagoo »

babelfish wrote: post #3

Combined results (Claude Mythos / Claude Opus 4.6 / GPT-5.4 / Gemini 3.1 Pro) SWE-bench Verified: 93.9% / 80.8% / — / 80.6% SWE-bench Pro: 77.8% / 53.4% / 57.7% / 54.2% SWE-bench Multilingual: 87.3% / 77.8% / — / — SWE-bench Multimodal: 59.0% / 27.1% / — / — Terminal-Bench 2.0: 82.0% / 65.4% / 75.1% / 68.5% GPQA Diamond: 94.5% / 91.3% / 92.8% / 94.3% MMMLU: 92.7% / 91.1% / — / 92.6–93.6% USAMO: 97.6% / 42.3% / 95.2%…

> Combined results (Claude Mythos / Claude Opus 4.6 / GPT-5.4 / Gemini 3.1 Pro)

> Terminal-Bench 2.0: 82.0% / 65.4% / 75.1% / 68.5%

> GPQA Diamond: 94.5% / 91.3% / 92.8% / 94.3%

> MMMLU: 92.7% / 91.1% / — / 92.6–93.6%

> USAMO: 97.6% / 42.3% / 95.2% / 74.4%

> OSWorld: 79.6% / 72.7% / 75.0% / —

Given that for a number of these benchmarks, it seems to be barely competitive with the previous gen Opus 4.6 or GPT-5.4, I don't know what to make of the significant jumps on other benchmarks within these same categories. Training to the test? Better training?

And the decision to withhold general release (of a 'preview' no less!) seems to be well, odd. And the decision to release a 'preview' version to specific companies? You know any production teams at these massive companies that would work with a 'preview' anything? R&D teams, sure, but production? Part of me wants to LoL.

What are they trying to do? Induce FOMO and stop subscriber bleed-out stemming from the recent negative headlines around problems with using Claude?

Re: System Card: Claude Mythos Preview [pdf]

#247

Post by mhluongo »

1attice wrote: post #161
TypesWillSaveUs wrote: post #151

Earlier quoted context omitted.

Describing providing a highly valuable service for money as `rent seeking` is pretty wild.

My housing is pretty valuable. I pay rent. Which timeline are you in?

Two different "rent"s.

Re: System Card: Claude Mythos Preview [pdf]

#248

Post by arm32 »

swalsh wrote: post #223
ru552 wrote: post #26

Earlier quoted context omitted.

There's speculation that next Tuesday will be a big day for OpenAI and possibly GPT 6. Anthropic showed their hand today.

My understanding is GPT 6 works via synaptic space reasoning... which I find terrifying. I hope if true, OpenAI does some safety testing on that, beyond what they normally do.

Oh, of course they will /s

Re: System Card: Claude Mythos Preview [pdf]

#249

Post by aurareturn »

apetresc wrote: post #191

I've long maintained that the real indicator that AGI is imminent is that public availability stops being a thing. If you truly believed you had a superhuman, godlike mind in your thrall, renting it out for $20/month would be the last thing you would choose to do with it.

I think they'll just increase the price to $1k/month. I don't think they will gate it as long as they can make sure it doesn't design a nuke for you, etc.

Re: System Card: Claude Mythos Preview [pdf]

#250

Post by arm32 »

GodelNumbering wrote: post #234

Priced at $25/$125 per million input/output token. Makes you wonder whether it makes more financial sense to hire 1-2 engineers in a cheap cost of living country who use much cheaper LLMs

The issue is that those engineers have to have good taste, but yes—absolutely. Ah, industrialization.
Post reply on HN