[flagged]
Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
301–310 of 656 posts
Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
#302First of all I found that fable is trained in a way that even if you were to jailbreak it, it would be completely uninterested in exploitation or finding creative solutions for explotation. However, I am unable to verify if this is related to them doing secretive prompt injection. Opus 4.8 is far more powerful in that regard. As for jailbreaking if anyone is interested: I used a fork of oh-my-pi that was modified in…
> First of all I found that fable is trained in a way that even if you were to jailbreak it, it would be completely uninterested in exploitation or finding creative solutions for explotation.
This is quite relevant if true. People have tried to argue for this restriction by claiming the exact opposite, i.e. that a basic jailbreak of Fable immediately exposes Mythos's cyber offense capabilities. E.g. https://news.ycombinator.com/item?id=48519695 It makes a lot of sense that Fable would also be fine-tuned or steered away from cyber offense topics, since they're reasonably easy to identify and Anthropic has demonstrated this capability wrt. other stuff.
Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
#303Earlier quoted context omitted.
Claims of retribution aside, one steelman is that Mythos is likely the most capable model that's usable by folks like the NSA [1], and decision-makers across the USG and industry partners have seen a stream of reports of Mythos successfully finding serious vulnerabilities over the past couple months due to Glasswing. So even if GPT 5.5 is just as capable in these scenarios (which, imo, it largely is), it is not known…
I doubt that the capabilities of GPT-5.5-cyber aren’t known by the US government considering OpenAI is their primary LLM partner after Anthropic had concerns about using models for autonomous weaponry and mass surveillance of US citizens. If anything, they should have more experience in GPT-5.5s full feature set due to longer access and may even already have GPT-5.6 access.
[dead]
Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
#304I have to imagine that this could be the result of Anthropic C-Levels catastrophizing to push the idea their product is so powerful that it is also very dangerous and that opened them up to the government responded in kind. In other words I have to imagine they probably did this to themselves and should probably dial down the catastrophizing.
>https://darioamodei.com/post/policy-on-the-ai-exponential
Dario even called for export restrictions just 2 days ago, though he wanted it limited to chips. But the entire post is about increased regulation.
Hard not to see this as a you reap what you sow scenario.
Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
#305One of the things that I have come to trust the least in journalism is any WSJ story that says "people familiar with the matter said" Can anyone find another source for this?
Is your objection specifically to the WSJ, or to the sources not being named in general? If the former, yes, the are other outlets reporting this with independent sourcing (e.g. The Information).
In general the absence of any clear statement of the source having an ability to know the information.
Specifically, yes The WSJ journal "sources familiar with" has been the end point of research into many claims that I have tried to find the origin of.
A lot of stories report that the WSJ has reported...
The combination of the paywall limiting casual readers to check the context of a reference and the perception that a widely reported claim is true needs a stronger foundation than 'A source familiar with said [something that is frequently an interpretation rather than a direct observation]
So yes, I'm definitely prepared to accept independent sourcing. Do you have a link?
Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
#306I still am struggling to understand why they informed the government about something that is known to be an issue in every LLM. There is no LLM that cannot be jailbroken, so unless this means that we have reached the absolute maximum publicly accessible US made LLMs are allowed to operate at with GPT 5.5, this is not grounded in any sane regulation attempt. Does anyone know what limits Fable 5 has overstepped in the…
Because based upon on what Anthropic has told the “AI people” and military, it is dangerous if an adversary gets its hands in the cyber capabilities. Knowing that if they ignored it and something did happen, heads will roll. Blame Anthropic for that, or wait if they are all for safety, they shouldnt complain.
Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
#307Im not trying to be weird... but as someone in Europe.... are we toast? no more AI access ever again?
All the other ones including the Chinese ones are still available.
In the medium-term it will become like the F-35 program. A carrot for you to join a particular sphere of influence.
In the long-term, things get very weird and unpredictable, in my opinion.
Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
#308I would speculate this is about the costs that (a weakly safeguarded) Mythos imposes on them. Amazon is, among other things, a net guarantor of cyber security for AWS customers (large enterprises and government entities). Taking a ~10e7 server hardware fleet from a patch SLA of weeks/months to 1 day is (1) very costly for them (2) may not be feasible in short time frames due to the amount of additional capacity needed for larger, more frequent reboot waves
Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
#309Earlier quoted context omitted.
>The reason is pretty obvious. Anthropic tried to play hardball with the government that is one. Another is who is going into the first IPO. Troubles for Anthropic IPO would channel all those money into OpenAI's one. Check financial interests of this admin. Hint - they aren't with Anthropic. Third - most of the export and access controlled tech of the past wasn't productivity multiplier, nor human replacement. AI is…
Alternatively, this is the best advertising for which Anthropic could hope: "Our product, and nobody else's, is so good that the government declared us a threat to national security." If they bring it back for US-nationals only, maybe demanding ID for users, people will think it's the bees knees: "so dangerous that non-Americans can't have access" probably sounds like a ringing endorsement to some C-level decision ma…
What good is advertising if they can't actually sell the product?
Re: Amazon CEO's talks with U.S. officials triggered crackdown on Anthropic models
#310Why is it only foreigners who should get blocked then? Does that make sense?
That is the only way it is legal. This was an export directive from the Commerce department, using authority granted by Congress to control exports of tech. If they just told Anthropic to shut down a model without invoking an emergency order of export, there would be no legal authority for such an order.
Keep in mind that for all the troubles and trauma caused by the current USA government, they are really good at manipulating the legal system to get their way. This is just another example of it.