Live data from Hacker News

Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

wsj.com

431–440 of 656 posts

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#432
post #279
post #71

I still am struggling to understand why they informed the government about something that is known to be an issue in every LLM. There is no LLM that cannot be jailbroken, so unless this means that we have reached the absolute maximum publicly accessible US made LLMs are allowed to operate at with GPT 5.5, this is not grounded in any sane regulation attempt. Does anyone know what limits Fable 5 has overstepped in the…

The only reason I can see is because Amazon wanted something like this to happen. But I'm not sure what Amazon would gain from that, since they don't have their own competing frontier models.

Did it cross your mind that Amazon cares about the security of the United States and reported the jailbreak to protect it?

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#433

Earlier quoted context omitted.

That’s a terrible way to create AI regulations If they actually cared about this issue we’d have predictable laws and regulatory bodies that let companies actually plan There’s a reason royal fiat doesn’t lead to healthy economies. It’s just confusing and chaotic. It’s not clear why anyone would invest in a new model now. Then the next administration comes in and instantly, by fiat, they decide to lift the ban. The m…

In a parallel universe where we have Biden (or Democratic Party) administration, how different do you think the regulations / approach would be for this fast moving and unpredictable technology?

It’s hard not to see this ban as being motivated by retribution for refusing to use the models for spying and autonomous warfare.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#434

I wonder if there would be an equivalent of Non proliferation treaty like Nukes? I know it sounds crazy - but if there's even 0.1% chance that some models are so good that they can be used to hack into people's bank accounts - I, as the government, would not want that model to be publicly accessible. I would also request other countries to come to the table and sign this NPT(for AI). Public will still have access to…

if models are good at hacking software they are equally good at patching it

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#435
post #279

Earlier quoted context omitted.

The only reason I can see is because Amazon wanted something like this to happen. But I'm not sure what Amazon would gain from that, since they don't have their own competing frontier models.

Of course, Amazon wanted this to happen. They own 20% of Anthropic. Anthropic bleeds cash. They have to raise capital. There are only 2 ways: an IPO or follow-ons from existing investors. If the IPO gets delayed because of these restrictions, Anthropic will be forced to raise more capital from existing investors. And existing investors (Amazon) will end up owning more of Anthropic at a cheaper valuation.

Why would they have launched Fable on Bedrock if they knew they were going to be shutting it down a day later?

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#436
post #71

I still am struggling to understand why they informed the government about something that is known to be an issue in every LLM. There is no LLM that cannot be jailbroken, so unless this means that we have reached the absolute maximum publicly accessible US made LLMs are allowed to operate at with GPT 5.5, this is not grounded in any sane regulation attempt. Does anyone know what limits Fable 5 has overstepped in the…

Anthropic themselves have played up the dangers of Mythos, limited its release, etc. So if it can be jail broken then it specifically deserves controls, per Dario’s own manifestos. David Sacks - the “AI Czar” - also said the government asked Anthropic to patch the issue but they refused, which is bizarre. And that led to the export ban.

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#437

Earlier quoted context omitted.

That’s a terrible way to create AI regulations If they actually cared about this issue we’d have predictable laws and regulatory bodies that let companies actually plan There’s a reason royal fiat doesn’t lead to healthy economies. It’s just confusing and chaotic. It’s not clear why anyone would invest in a new model now. Then the next administration comes in and instantly, by fiat, they decide to lift the ban. The m…

In a parallel universe where we have Biden (or Democratic Party) administration, how different do you think the regulations / approach would be for this fast moving and unpredictable technology?

Probably using the rule of law in some way? Talking about it in public? Legislating? You know... government type stuff?

Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models

#439
post #314

putting my old man cap on and I would like to weigh in on the US admin export control on Mythos. It does remind me of the mid-1990s when suddenly asymmetric cryptographic tools such as PGP became a reality and a wide usage possible due to the growing base of internet users. Governments (US, France…) did not understand how to regulate and banned export (and asked users to apply for a licence). I do see a strong parall…

Following the PGP example, I wonder how long until "illegal" tshirts with weights printed on them start popping up.

You’re going to need a big shirt, right?
Post reply on HN