Live data from Hacker News

Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

wsj.com

331–340 of 656 posts

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#334

Just to put things in the right perspective to those who are not aware, Amazon heavily invests in Anthropic [0] and AWS is a partner on project Glasswing (Select companies that used Mythos to find critical vulnerabilities in major open source and critical infrastructure) [1] So I don't think there is anything sinister here, I would use Hanlon's razor [2] here... [0] https://www.anthropic.com/news/anthropic-amazon-com…

Or in my favourite formulation: “Never assume conspiracy where mere incompetence will do”.

The people of hacker news seem to really want this to be some sort of conspiracy. It's quite interesting to see.

"It's deliberate sabotage by Amazon", "It's retribution by Hegseth for embarrassing the DoW", "It's a brilliant marketing scheme by Anthropic", "It's because of the govt is considering investing in OpenAI and so they're crippling any competitors".

It's never just "a very poorly formed regulatory action in response to increasingly capable models".

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#335

Earlier quoted context omitted.

Yes OP is saying they didn’t pay all cash for those shares

So they dont care about it? How is that relevant? If I have 5% of a company, I dont care if I traded services or cash for it.

It’s relevant because it doesn’t actually signal anything about the parent company / shareholders commitment. Their ownership shares are nominally worth x billion dollars, which represents an enormous incentive to have the venture succeed - OTOH it does not represent the actual scale of the bet being made, because the shareholders never parted with z billions in the first place, just signed agreements to provide store credit for enormous cloud resources

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#337
post #278
post #71

I still am struggling to understand why they informed the government about something that is known to be an issue in every LLM. There is no LLM that cannot be jailbroken, so unless this means that we have reached the absolute maximum publicly accessible US made LLMs are allowed to operate at with GPT 5.5, this is not grounded in any sane regulation attempt. Does anyone know what limits Fable 5 has overstepped in the…

I submitted separately, but this Axios report has some details that call a lot of the speculation in this thread into question, i.e. that this wasn't much of a "jailbreak" at all and that it's not Anthropic-specific - the White House intends to generally regulate Mythos-class models (whatever exactly that means): Between the lines: The government's response "seems way out of line with what's actually in the research…

That’s a terrible way to create AI regulations

If they actually cared about this issue we’d have predictable laws and regulatory bodies that let companies actually plan

There’s a reason royal fiat doesn’t lead to healthy economies. It’s just confusing and chaotic. It’s not clear why anyone would invest in a new model now.

Then the next administration comes in and instantly, by fiat, they decide to lift the ban. The market just gets jerked around with no ability to plan long term investments.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#338
post #314

putting my old man cap on and I would like to weigh in on the US admin export control on Mythos. It does remind me of the mid-1990s when suddenly asymmetric cryptographic tools such as PGP became a reality and a wide usage possible due to the growing base of internet users. Governments (US, France…) did not understand how to regulate and banned export (and asked users to apply for a licence). I do see a strong parall…

Interesting comparison, thanks for sharing! It reminds me of this post about how machine learning and encryption have some fundamental similarities: https://reiner.org/neural-net-ciphers

> I can certainly imagine LLMs taking a similar path. Maybe it's useful to think about what fundamental differences could contribute to LLMs taking a very different path. What comes to mind is the scaling hypothesis, implying that the best LLMs will require enormous capital investment.

That seems largely incompatible with open source barring a fundamental change. There's open weights, but I can't think of a clean historical analogy there and find it extremely difficult to even guess how the future will go

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#339
post #71

I still am struggling to understand why they informed the government about something that is known to be an issue in every LLM. There is no LLM that cannot be jailbroken, so unless this means that we have reached the absolute maximum publicly accessible US made LLMs are allowed to operate at with GPT 5.5, this is not grounded in any sane regulation attempt. Does anyone know what limits Fable 5 has overstepped in the…

They literally asked for it. Two days ago Amodei wrote an essay urging the government to regulate them. He explicitly cited Mythos, as proof that frontier AI has acquired autonomous hacking capabilities that threaten critical infrastructure and national security.

  "Mythos Preview scrambled the global cybersecurity landscape. But its broader significance is that it proves beyond doubt that AI models are now tools of global and national strategic consequence." 


  "The government should have the power to block or deter deployment of the model if it is determined, in light of third-party assessment, to present unacceptable risks. This power must be scoped to the above four specific risks and there must be protective measures against political favoritism or arbitrary decisions" 
https://darioamodei.com/post/policy-on-the-ai-exponential

A third-party demonstrated that it was possible to jailbreak the safety measures of Fable to access the raw Mythos abilities. Abilities which Anthropic say are too dangerous for the public.

Edit. From David Sacks:

  — A highly credible trusted partner of both Anthropic and the USG who was testing Fable came forward with a jailbreak of those guardrails. The Admin asked Dario to fix the jailbreak or de-deploy the model. Dario refused.

   — In their blog post, Anthropic defended its decision by saying the jailbreak isn’t serious. That is not what the trusted partner and the USG believe; nor is that kind of minimizing language consistent with Anthropic’s brand as the AI safety company. It’s difficult to fathom how they could claim a jailbreak allowing operability of a cyber weapon could be defined as not “serious".

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#340
post #314

putting my old man cap on and I would like to weigh in on the US admin export control on Mythos. It does remind me of the mid-1990s when suddenly asymmetric cryptographic tools such as PGP became a reality and a wide usage possible due to the growing base of internet users. Governments (US, France…) did not understand how to regulate and banned export (and asked users to apply for a licence). I do see a strong parall…

Following the PGP example, I wonder how long until "illegal" tshirts with weights printed on them start popping up.

If they ban GPUs we can always multiply the matrices on paper
Post reply on HN