Live data from Hacker News

System Card: Claude Mythos Preview [pdf]

www-cdn.anthropic.com

141–150 of 687 posts

Re: System Card: Claude Mythos Preview [pdf]

#141

Earlier quoted context omitted.

A jump that we will never be able to use since we're not part of the seemingly minimum 100 billion dollar company club as requirement to be allowed to use it. I get the security aspect, but if we've hit that point any reasonably sophisticated model past this point will be able to do the damage they claim it can do. They might as well be telling us they're closing up shop for consumer models. They should just say they…

This is why the EAs, and their almost comic-book-villain projects like "control AI dot com" cannot be allowed to win. One private company gatekeeping access to revolutionary technology is riskier than any consequence of the technology itself.

No it isn't lol. The consequence of the technology literally includes human extinction. I prefer 0 companies, but I'll take 1 over 5.

Re: System Card: Claude Mythos Preview [pdf]

#144
post #85

Their best model to date and they won’t let the general public use it. This is the first moment where the whole “permanent underclass” meme starts to come into view. I had through previously that we the consumers would be reaping the benefits of these frontier models and now they’ve finally come out and just said it - the haves can access our best, and have-nots will just have use the not-quite-best. Perhaps I was be…

This is the playbook since GPT2

Re: System Card: Claude Mythos Preview [pdf]

#145
post #67

Earlier quoted context omitted.

That has also been my experience. And if Mythos is even worse, unless you have a significantly awesome harness, sounds like pretty unusable if you don't want to risk those problems.

I think are fundamental issues with the story that Anthropic is selling. AGI is very close, we will definitely get there, it is also very dangerous...so Anthropic should be the only ones trusted with AGI. If you look at recent changes in Opus behaviour and this model that is, apparently, amazingly powerful but even more unsafe...seems suspect.

This makes sense if Anthropic think they're the best-positioned to make safe AI. However if you are looking at an AI company there's obviously some selection happening.

Re: System Card: Claude Mythos Preview [pdf]

#146

A System „Card“ spanning 244 pages. Quite a stretch of the original word meaning.

> A System „Card“ spanning 244 pages. Probably because they asked Claude to write it.

Yes. It would be three times as much if they used ChatGPT.

Re: System Card: Claude Mythos Preview [pdf]

#147
post #121

Earlier quoted context omitted.

Can LLMs be AGI at all?

Good question. I would guess no - but it could help you build one. Am I mistaken?

No I think that’s accurate. They seem more like an oracle to me. Or as someone put it here, it’s a vectorization of (most/all?) human knowledge, which we can replay back in various permutations.

Re: System Card: Claude Mythos Preview [pdf]

#148
post #130

Earlier quoted context omitted.

uhh the model found actual vulnerabilities in software that people use. either you believe that the vulnerabilities were not found or were not serious enough to warrant a more thoughtful release

So did GPT-4. https://arxiv.org/html/2402.06664v1 Like think carefully about this. Did they discover AGI? Or did a bunch of investors make a leveraged bet on them "discovering AGI" so they're doing absolutely anything they can to make it seem like this time it's brand new and different. If we're to believe Anthropic on these claims, we also have to just take it on faith, with absolutely no evidence, that they've made…

I don't see the problem here. How would you have handled it differently? If you released this model as such without any safety concern, the vulnerabilities might be found by bad actors and used for wrong things.

What do you find surprising here?

Re: System Card: Claude Mythos Preview [pdf]

#149
post #101

Earlier quoted context omitted.

Well don’t forget we still have competition. Were anthropic to rent seek OpenAI would undercut them. Were OpenAI and anthropic to collude that would be illegal. For anthropic to capture the entire coding agent market and THEN rent seek, these days it’s never been easier to raise $1B and start a competing lab

In practice this doesn't work though, the Mastercard-Visa duopoly is an example, two competing forces doesn't create aggressive enough competition to benefit the consumer. The only hope we have is the Chinese models, but it will always be too expensive to run the full models for yourself.

New companies can enter this space. Google’s competing, though behind. Maybe Microsoft, Meta, Amazon, or Apple will come out with top notch models at some point.

There is no real barrier to a customer of Anthropic adopting a competing model in the future. All it takes is a big tech company deciding it’s worth it to train one.

On the other hand, Visa/Mastercard have a lot of lock-in due to consumers only wanting to get a card that’s accepted everywhere, and merchants not bothering to support a new type of card that no consumer has. There’s a major chicken and egg problem to overcome there.

Re: System Card: Claude Mythos Preview [pdf]

#150

Opus 4.6 is already incredible so this leap is huge. Although, amusingly, today Opus told me that the string 'emerge' is not going to match 'emergency' by using `LIKE '%emerge%'` in Sqlite Moment of disappointment. Otherwise great.

'emer ge' is two tokens, 'emergency' is one. The models think in a logosyllabic language.
Post reply on HN