Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic's Safety Superpower

stratechery.com

Post reply on HN
Print view View original

31–40 of 206 posts

Re: Anthropic's Safety Superpower

#31

Post by mofeien »

kordlessagain wrote: post #2

> To that end, I can certainly buy the case that Fable/Mythos is in fact more capable when it comes to identifying and exploiting security issues This has been covered before: https://aisle.com/blog/ai-cybersecurity-after-mythos-the-jag... ( https://news.ycombinator.com/item?id=47732020 ) > Anthropic’s cautious roll-out was justified. The problem with publicly releasing models, however, is that guardrails can be jail…

The top comment in the very discussion you linked on that AISLE blog has a strong rebuttal to that blog post...

Re: Anthropic's Safety Superpower

#32

Post by baq »

thefounder wrote: post #19
olmo23 wrote: post #12

Earlier quoted context omitted.

> no nationality controls in place Not for now, but how long before we have KYC regulations concerning LLMs?

That’s really what Dario wants. Let’s hope he doesn’t get it

what Dario wants is to retain any influence whatsover on how the research progresses before the inevitable nationalization of the frontier. he gets to keep the N-2 tech and maybe influence the N-1 tech, but the only influence on the frontier he has is today; whatever he imprints in the pipeline the government takes over.

IOW I don't think he thinks in the same categories as most folks here.

Re: Anthropic's Safety Superpower

#33

Post by baq »

dofm wrote: post #29
thefounder wrote: post #19

Earlier quoted context omitted.

That’s really what Dario wants. Let’s hope he doesn’t get it

Regulatory capture is the OpenAI and Anthropic end goal, for certain. But I also think they exist in a sort of un-designed corporate narcissism, which is a common trait in bubble economies — I am not judging them particularly severely. Netscape under Clark and Andreessen and Sun under McNealy both fell into corporate narcissism: the belief that only they really mattered, that they were chosen, and that the world need…

> Regulatory capture is the OpenAI and Anthropic end goal, for certain.

it has to be, because the other way around - the government taking over parts or the whole thing - is inevitable if the trend holds.

Re: Anthropic's Safety Superpower

#34

Post by throw1234567891 »

olmo23 wrote: post #12
botw44 wrote: post #9

The whole thesis falls apart though. You can't be on your way to "power over everything" and get distilled into free Chinese models within months. Pick one. The bottleneck is compute and data, not the model. That's why they could only gate it for a bit. The ITAR thing proves it: no nationality controls in place, so the only option was killing the whole thing. Not exactly what an all-powerful gatekeeper does.

> no nationality controls in place Not for now, but how long before we have KYC regulations concerning LLMs?

Yeah yeah, but after the IPO!

Re: Anthropic's Safety Superpower

#35

Post by dofm »

baq wrote: post #33
dofm wrote: post #29

Earlier quoted context omitted.

Regulatory capture is the OpenAI and Anthropic end goal, for certain. But I also think they exist in a sort of un-designed corporate narcissism, which is a common trait in bubble economies — I am not judging them particularly severely. Netscape under Clark and Andreessen and Sun under McNealy both fell into corporate narcissism: the belief that only they really mattered, that they were chosen, and that the world need…

> Regulatory capture is the OpenAI and Anthropic end goal, for certain. it has to be, because the other way around - the government taking over parts or the whole thing - is inevitable if the trend holds.

Porque no los dos?

Re: Anthropic's Safety Superpower

#36

Post by khalic »

chasil wrote: post #26
khalic wrote: post #10

Earlier quoted context omitted.

This is how the US gov does business now, capricious and vengeful. Textbook retaliation for not letting them use an abliterated version of Claude in weapons systems. This effectively renders any US closed model useless for any foreign company. Could happen to OpenAI, Google, etc. Too much of a risk to implement something that can be yanked out because the company didn’t behave the way they want. Looks like it’s time…

Consider this quote from the main article... "When you further combine this realization with the company’s pronouncements about AI’s ability to conduct all economic activity, you realize that Anthropic’s leadership effectively wants to have power over everything and everyone." This is fearful stuff on all sides, and none of the people involved might realistically be able to navigate the danger.

That part just sounds like hyperbole at best, conspiracy at worst.

By that logic, anybody who values safety has a god complex? It’s absurd…

Re: Anthropic's Safety Superpower

#37

Post by baq »

dofm wrote: post #35
baq wrote: post #33

Earlier quoted context omitted.

> Regulatory capture is the OpenAI and Anthropic end goal, for certain. it has to be, because the other way around - the government taking over parts or the whole thing - is inevitable if the trend holds.

Porque no los dos?

this is exactly the play is my point

Re: Anthropic's Safety Superpower

#38

Post by khalic »

chasil wrote: post #27
WithinReason wrote: post #16

Earlier quoted context omitted.

Could Anthropic relocate to a different country?

Individuals can leave, but the company cannot transfer restricted intellectual property. Europe has extradition treaties, so the U.S. can force anyone in Europe back to the U.S. for criminal indictment who demonstrates inappropriate possession of this technology.

Well, force is a strong word… it’s still just accords, that the US doesn’t seem to be valuing lately… so if they say no, what’s the US going to do? Start a war over a company?

Re: Anthropic's Safety Superpower

#39

Post by blitzar »

ben_w wrote: post #20
Peterz_shu wrote: post #7

This is the part where the USA and allied countries can gain a headstart from using such an overpowered model. This only just shows how strong Mythos/Fable will be, once released to the public. I'm guessing about 0.5 year till public.

> USA and allied countries Doesn't this *exclude* allies countries?

They are probably thinking of the "Board of Peace"

Re: Anthropic's Safety Superpower

#40

Post by chasil »

khalic wrote: post #36
chasil wrote: post #26

Earlier quoted context omitted.

Consider this quote from the main article... "When you further combine this realization with the company’s pronouncements about AI’s ability to conduct all economic activity, you realize that Anthropic’s leadership effectively wants to have power over everything and everyone." This is fearful stuff on all sides, and none of the people involved might realistically be able to navigate the danger.

That part just sounds like hyperbole at best, conspiracy at worst. By that logic, anybody who values safety has a god complex? It’s absurd…

I am just quoting the parent article.

"What this degradation represented was both the capability and willingness of Anthropic to silently alter its models to achieve its policy preferences. In other words, Anthropic willfully validated some of its critics’ worst fears in terms of being a supply chain risk."

Post reply on HN