Live data from Hacker News

Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

wsj.com

321–330 of 656 posts

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#321
post #7

Amazon is a large Anthropic shareholder (>5% of the cap table). I think it’s impossible to interpret the actions of their executives here without considering this information.

To me it reads like the execs at Amazon told the feds about some capability they were excited about, and the government officials either didn't understand it fully or overreacted to some small feature, panicked and went to ban it.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#322
post #318

Earlier quoted context omitted.

I mean it's possible that I just haven't found the secret sauce or I'm running into the invisible guardrails and that people have much stronger jailbreaks than I do. However, I would not rule out openai involvement in all of this.

I was able to use Fable to generate PoC for several classes of vulnerabilities and I didn't observe the model refusing to engage in detailed analysis to come up with creative approaches, the very contrary. > I used a fork of oh-my-pi Why not use the leaked claude code source? Not that you really need it to execute the jailbreak

I don't think educational "proof of concept" code can be described as even loosely realistic cyber offense in this day and age. The Mythos preview paper claimed an ability to stage attacks in an end-to-end fashion and work around sophisticated defenses/mitigations, so something like this should be the relevant standard.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#323

Earlier quoted context omitted.

I think you underestimate how many people actually care about mass shootings.

> I think you underestimate how many people actually care about mass shootings. Less than 1% of the population, that’s for sure. You remember the last protest about school shootings? Neither do I.

Because it has moved way beyond protests. Everyone agrees that school shootings are bad. Legislation has been passed. Policies have changed. Schools have changed their security tactics. There have been years and years of meetings across the country with school administrators and boards talking about how to improve safety and navigate these issues, and then the schools themselves implementing new practices.

If you are looking around and saying that because people aren't waving sign on street corners, then nobody cares, then you have utterly missed a couple decades of dedicated efforts by many people working around these issues.

The fact that shootings still happen is tragic. But it is not because people are just shrugging and saying they don't care.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#324
post #314

putting my old man cap on and I would like to weigh in on the US admin export control on Mythos. It does remind me of the mid-1990s when suddenly asymmetric cryptographic tools such as PGP became a reality and a wide usage possible due to the growing base of internet users. Governments (US, France…) did not understand how to regulate and banned export (and asked users to apply for a licence). I do see a strong parall…

Following the PGP example, I wonder how long until "illegal" tshirts with weights printed on them start popping up.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#325
post #317
post #309

Earlier quoted context omitted.

What good is advertising if they can't actually sell the product?

Customers (especially large ones) don't so much buy individual specific products, they buy into a company and its prospects. Customers don't want to chop and change. They want to lock in with the leader. This whole thing shrieks out that Anthropic is at the head of the pack, with the most capable models. It hardly matters in the customer's mind that today they can't buy this specific model.

The same customers that are barred by law from using antrhopic on any government contracts. If they get past that, they are then cant have any foreign workers use state of the art anthropic models. SOTA anthropic models also can work with working in any secure government clouds or with sensitive customer data due to retention policies.

It is hard to see being a new benefit for anthropic.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#326

Earlier quoted context omitted.

The simple answer is that Trump has a stick up his ass against Anthropic and is also fond of stock market manipulation. No need to get too deep when it comes to dealing with that orange shmuck.

This is just another shakedown like with Tylenol etc, knock the product, lower the stock price and have a competitor hostile takeover, or get kickbacks

This is a hypothesis, and a viable one.

But I caution you against drawing conclusions from your hypothesis and calling it a day, instead of taking in the available data and using it to broaden your understanding of what's actually happening.

This could be many things: a shakedown, Trump's pettiness, marketing kayfabe, an actual government reaction to a very weaponizable technology, and so on.

But if you call it "just another shakedown" and go about your day, then you're doing yourself a disservice, because the story is still unfolding and we don't have all the facts.

You don't actually have the full story, so don't delude yourself into think you do.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#327

Unfortunately even if this blocking is only temporary, a precedent has been set. The government will likely be more willing to target open source models in the future that they deem to be too powerful. A lot of open source AI infrastructure exists within reach of the US government.

I keep imagining what we would be hearing on loop if a Dem administration had done this.

"Typical Dem overreach and regulation! The nanny state!"

"Frontier models are expensive to create! Why should US companies continue to invest in them, if the government won't let them make sales! This is how China wins!"

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#328
post #318

Earlier quoted context omitted.

I was able to use Fable to generate PoC for several classes of vulnerabilities and I didn't observe the model refusing to engage in detailed analysis to come up with creative approaches, the very contrary. > I used a fork of oh-my-pi Why not use the leaked claude code source? Not that you really need it to execute the jailbreak

I don't think educational "proof of concept" code can be described as even loosely realistic cyber offense in this day and age. The Mythos preview paper claimed an ability to stage attacks in an end-to-end fashion and work around sophisticated defenses/mitigations, so something like this should be the relevant standard.

Depends of what the proof of concept is about. It could be just a toy example, e.g. a RCE that opens the calculator app or something much more nefarious, like returning a root shell and would still fall under the definition of PoC.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#330
post #279
post #71

I still am struggling to understand why they informed the government about something that is known to be an issue in every LLM. There is no LLM that cannot be jailbroken, so unless this means that we have reached the absolute maximum publicly accessible US made LLMs are allowed to operate at with GPT 5.5, this is not grounded in any sane regulation attempt. Does anyone know what limits Fable 5 has overstepped in the…

The only reason I can see is because Amazon wanted something like this to happen. But I'm not sure what Amazon would gain from that, since they don't have their own competing frontier models.

This is either a complete own goal by Amazon… a play to consolidate compute/model access.

Will Chinese models be allowed on the market… at all? Will startups be banned from training models of equivalent capacity?

Post reply on HN