Live data from Hacker News

Anthropic's Safety Superpower

stratechery.com

41–50 of 206 posts

Re: Anthropic's Safety Superpower

#42
post #26
post #10

Earlier quoted context omitted.

This is how the US gov does business now, capricious and vengeful. Textbook retaliation for not letting them use an abliterated version of Claude in weapons systems. This effectively renders any US closed model useless for any foreign company. Could happen to OpenAI, Google, etc. Too much of a risk to implement something that can be yanked out because the company didn’t behave the way they want. Looks like it’s time…

Consider this quote from the main article... "When you further combine this realization with the company’s pronouncements about AI’s ability to conduct all economic activity, you realize that Anthropic’s leadership effectively wants to have power over everything and everyone." This is fearful stuff on all sides, and none of the people involved might realistically be able to navigate the danger.

the whole thing playing out as expected. if you think about it, the only question is the timeline.

the next model with a gap to mythos as mythos is to opus will be controlled technology from the get-go. the one after it may be top secret.

Re: Anthropic's Safety Superpower

#43
post #33
post #29

Earlier quoted context omitted.

Regulatory capture is the OpenAI and Anthropic end goal, for certain. But I also think they exist in a sort of un-designed corporate narcissism, which is a common trait in bubble economies — I am not judging them particularly severely. Netscape under Clark and Andreessen and Sun under McNealy both fell into corporate narcissism: the belief that only they really mattered, that they were chosen, and that the world need…

> Regulatory capture is the OpenAI and Anthropic end goal, for certain. it has to be, because the other way around - the government taking over parts or the whole thing - is inevitable if the trend holds.

the inevitable trend is that numbers will be free and nobody will control the whole thing

ai-celebrities are just clinging to relevance like all the other celebrities out there

Re: Anthropic's Safety Superpower

#44
post #9

The whole thesis falls apart though. You can't be on your way to "power over everything" and get distilled into free Chinese models within months. Pick one. The bottleneck is compute and data, not the model. That's why they could only gate it for a bit. The ITAR thing proves it: no nationality controls in place, so the only option was killing the whole thing. Not exactly what an all-powerful gatekeeper does.

The distilled versions miss the spark of the model. Its like they land in the uncanny valley of models.

Re: Anthropic's Safety Superpower

#45

Earlier quoted context omitted.

No. If we cannot even have an EU CloudFlare, then we definitely do not have the infra for this kind of computing. The EU options are not even close to what CF can do

There are fortunately some initiatives and interesting developments in the European market. Take bunny.net for example. We have to start somewhere in Europe, right? Better late than never.

This infrastructure may not even be needed in the next decade. Europe should have done this 20 years ago.

Re: Anthropic's Safety Superpower

#46
post #40
post #36

Earlier quoted context omitted.

That part just sounds like hyperbole at best, conspiracy at worst. By that logic, anybody who values safety has a god complex? It’s absurd…

I am just quoting the parent article. "What this degradation represented was both the capability and willingness of Anthropic to silently alter its models to achieve its policy preferences. In other words, Anthropic willfully validated some of its critics’ worst fears in terms of being a supply chain risk."

Again, hyperbole and assumption of evil intent because… they take precautions? Nice prose doesn’t dispense you from forming a sound hypothesis

Re: Anthropic's Safety Superpower

#48
post #12
post #9

The whole thesis falls apart though. You can't be on your way to "power over everything" and get distilled into free Chinese models within months. Pick one. The bottleneck is compute and data, not the model. That's why they could only gate it for a bit. The ITAR thing proves it: no nationality controls in place, so the only option was killing the whole thing. Not exactly what an all-powerful gatekeeper does.

> no nationality controls in place Not for now, but how long before we have KYC regulations concerning LLMs?

[deleted]

Re: Anthropic's Safety Superpower

#49
post #10
post #3

(reposted) As I understand it, ITAR regulations for export controls have just been applied to any form of Mythos. These are overseen by U.S. Departments of State and Commerce, and forbid foreign nationals from access to any form of Mythos, either within or outside the U.S. Only U.S. citizens and immigrants that are holders of a "green card" may now access Mythos. It appears that Anthropic does not have internal contr…

This is how the US gov does business now, capricious and vengeful. Textbook retaliation for not letting them use an abliterated version of Claude in weapons systems. This effectively renders any US closed model useless for any foreign company. Could happen to OpenAI, Google, etc. Too much of a risk to implement something that can be yanked out because the company didn’t behave the way they want. Looks like it’s time…

This is a suicide shot for the American economy. The numbers only lined up for AI to rescue the USA from its debt if it captured a significant portion of the world's AI spend, and while it was a longshot before, there's basically zero percent chance the world trusts American AI when the government is pulling strings.

Re: Anthropic's Safety Superpower

#50
post #42
post #26

Earlier quoted context omitted.

Consider this quote from the main article... "When you further combine this realization with the company’s pronouncements about AI’s ability to conduct all economic activity, you realize that Anthropic’s leadership effectively wants to have power over everything and everyone." This is fearful stuff on all sides, and none of the people involved might realistically be able to navigate the danger.

the whole thing playing out as expected. if you think about it, the only question is the timeline. the next model with a gap to mythos as mythos is to opus will be controlled technology from the get-go. the one after it may be top secret.

Open models will catch up eventually, TOTL models will get distilled into smaller, more efficient versions, it’s not something you can moat indefinitely
Post reply on HN