Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic drops flagship safety pledge

time.com

Post reply on HN
Print view View original

451–460 of 716 posts

Re: Anthropic drops flagship safety pledge

#451

Post by sigbottle »

bogzz wrote: post #442

Does anyone have insight into, or an interesting source to read, on what exactly Anthropic/OpenAI are doing/can do for a military? Reporters are unsurprisingly fearmongering about Claude "being used in surveillance, autonomous robots, and target acquisition" but AFAIK all Anthropic does is work with LLMs. Are people really attempting to have LLMs replace vision models in robots, and trying to agentically make a robot…

You're thinking too advanced. What kind of automated system is good at scanning semantically trillions of chat logs and finding nontrivial correlations, for example? 10000 codex 5.1s can easily crawl through that in a few days, probably.

It's just systems plumbing (surveillance) and AI. It's a combination of weaker technologies and consolidation of power.

This does not require a physical robot super AGI(though I would not be surprised if fully autonomous robots are not on the table already)

Re: Anthropic drops flagship safety pledge

#452

Post by motbus3 »

skeptic_ai wrote: post #402
shubhamjain wrote: post #352

I was wondering if it was because of heavy-handedness of the administration, but apparently: > The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter. Their core argument is that if we have guardrails that others don't, they would be left behind in controlling the technology, and they are the "responsible ones." I honestly can't compreh…

OpenAI never open sourced anything relevant or in time. Internal email leaks they only cared to become billionaires. Claude only talks about safety, but never released anything open source. All this said I’m surprised China actually delivered so many open source alternatives. Which are decent. Why westerns (which are supposed to be the good guys) didn’t release anything open source to help humanity ? And always claim…

It is hard to understand why other ai companies are still providing models weights at this point

My guess is that they know they are not competitors so they make it cheaper or free to hinder the surge of a super competitor.

Re: Anthropic drops flagship safety pledge

#453

Post by nozzlegear »

Schlagbohrer wrote: post #404
drzaiusx11 wrote: post #325

Public benefit corporations in the AI space have become a farce at this point. They're just regular corporations wearing a different hat, driven by the same money dynamics as any other corp. They have no ability to balance their stated "mission" with their drive for profit. When being "evil" is profitable and not-evil is not, guess which road they'll take...

Pete Hegseth also threatened to take, by dictat, everything Anthropic has. He can do that with the Defense Industrial Act or whatever its called if he designates them as critical to national defense.

It would've been better PR for Anthropic to let Hegseth do that instead of fold at the slightest hint of pressure and lost contract money. I've canceled my Claude subscription over this (and made sure to let them know in the feedback).

Re: Anthropic drops flagship safety pledge

#454

Post by HardCodedBias »

bix6 wrote: post #329
FrustratedMonky wrote: post #322

This was under duress that government was going to use emergency act to force them anyway. I kind of wish they had forced the governments hand and made them do it. Just to show the public how much interference is going on. They say it wasn't related. Like every thing that has happened across tech/media, the company is forced to do something, then issues statement about 'how it wasn't related to the obvious thing the…

> Katie Sweeten, a former liaison for the Justice Department to the Department of Defense, said she’s not sure how the Pentagon can both declare a company to be a supply chain risk and compel that same company to work with the military. Makes perfect sense!!

Of course it can do both. They are synergistic.

Re: Anthropic drops flagship safety pledge

#455

Post by TheOtherHobbes »

HardCodedBias wrote: post #450
ACCount37 wrote: post #432

Earlier quoted context omitted.

That's because it is. AI is powerful and AI is perilous. Those two aren't mutually exclusive. Those follow directly from the same premise. If AI tech goes very well, it can be the greatest invention of all human history. If AI tech goes very poorly, it can be the end of human history.

"If AI tech goes very well, it can be the greatest invention of all human history" As has been said at many all hands: Let's all work on the last invention needed by humans.

Except it's more likely to be the last invention that needs humans.

Re: Anthropic drops flagship safety pledge

#456

Post by bogzz »

sigbottle wrote: post #451
bogzz wrote: post #442

Does anyone have insight into, or an interesting source to read, on what exactly Anthropic/OpenAI are doing/can do for a military? Reporters are unsurprisingly fearmongering about Claude "being used in surveillance, autonomous robots, and target acquisition" but AFAIK all Anthropic does is work with LLMs. Are people really attempting to have LLMs replace vision models in robots, and trying to agentically make a robot…

You're thinking too advanced. What kind of automated system is good at scanning semantically trillions of chat logs and finding nontrivial correlations, for example? 10000 codex 5.1s can easily crawl through that in a few days, probably. It's just systems plumbing (surveillance) and AI. It's a combination of weaker technologies and consolidation of power. This does not require a physical robot super AGI(though I woul…

Ah, well that makes sense. In that case, it's another tool in the toolbelt, not a plug-and-play drone brain, as some reporters amusingly make it out to be.

Re: Anthropic drops flagship safety pledge

#458

Post by re-thc »

ACCount37 wrote: post #441
afavour wrote: post #426

Earlier quoted context omitted.

It's exhausting to keep with mainstream AI news because of this. I can never work out if the companies are deluded and truly believe they're about to create a singularity or just claiming they are to reassure investors/convince the public of their inevitability.

It's a fairly mainstream position among the actual AI researchers in the frontier labs. They disagree on the timelines, the architectures, the exact steps to get there, the severity of risks. Can you get there with modified LLMs by 2030, or would you need to develop novel systems and ride all the way to 2050? Is there a 5% chance of an AI oopsie ending humankind, or a 25% chance? No agreement on that. But a short lin…

> But a short line "AGI is possible, powerful and perilous"

> At which point the question becomes: is it them who are deluded, or is it you?

No one. It is always "possible". Ask me 20 years ago after watching a sci-fi movie and I'd say the same.

Just like with software projects estimating time doesn't work reliably for R&D.

We'll still get full self-driving electric cars and robots next year too. This applies every year.

Re: Anthropic drops flagship safety pledge

#459

Post by PeterStuer »

We wont push forward unless you push forward is textbook market collusion.

Even if it were ever done with good intentions, it is an open invitation for benefit hoarding and margin fixing.

Do you realy want to create this future where only a select few anointed companies and some governments have access to super advanced intelligent systems, where the rest of the planet is subjected to and your own ai access is limited to benign basal add pushing propaganda spewing chatbots as you bingewatch the latest "aw my ballz"?

Re: Anthropic drops flagship safety pledge

#460

Post by jMyles »

I pray that we can all get to the following simple standard:

* AI and states cannot peacefully coexist, and AI is not going to be stopped. Therefore, we must begin to deprecate states.

I think it's very unlikely that this is unrelated to the pressure from the US administration, as the anonymous-but-obvious-anthropic-spokesperson asserts.

We're at a point now where the nation states are all totally separate creatures from their constituencies, and the largest three of them are basically psychotic and obsessed with antagonizing one another.

In order to have a peaceful AI age, we need _much_ smaller batches of power in the world. The need for states that claim dominion over whole continents is now behind us; we have all the tools we need to communicate and coordinate over long distances without them.

Please, I pray for a gentle, peaceful anarchism to emerge within the technocratic leagues, and for the elder statesmen of the legacy states to see the writing on the wall and agree to retire with tranquility and dignity.

Post reply on HN