Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic drops flagship safety pledge

time.com

Post reply on HN
Print view View original

571–580 of 716 posts

Re: Anthropic drops flagship safety pledge

#571

Post by oatmeal1 »

shubhamjain wrote: post #352

I was wondering if it was because of heavy-handedness of the administration, but apparently: > The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter. Their core argument is that if we have guardrails that others don't, they would be left behind in controlling the technology, and they are the "responsible ones." I honestly can't compreh…

90% of the people cancer kills are over 50. Old people who start believing everything they see on Facebook, but continue voting, with even greater confidence in their opinions. Old people who voted in Trump. Curing cancer would be just about the worst thing AI could do.

Re: Anthropic drops flagship safety pledge

#572

Post by inigyou »

Eldt wrote: post #510
visarga wrote: post #493

Earlier quoted context omitted.

John Good's quote is pretty myopic, it assumes machines make better machines based on being "ultraintelligent" instead of learning from environment-action-outcome loop. It's the difference between "compute is all you need" and "compute+explorative feedback" is all you need. As if science and engineering comes from genius brains not from careful experiments.

Maybe ultraintelligence is having an improved environment-action-outcome loop. Maybe that's all intelligence really is

In that case, it can't be improved with bigger computers.

Re: Anthropic drops flagship safety pledge

#573

Post by iranintoavan »

bn_layc wrote: post #429
Schlagbohrer wrote: post #404

Earlier quoted context omitted.

Pete Hegseth also threatened to take, by dictat, everything Anthropic has. He can do that with the Defense Industrial Act or whatever its called if he designates them as critical to national defense.

He seems to be the driving force behind all this. Mediocrities are attracted to AI like moths. The press always say "the Pentagon negotiates". Does any publication have an evidence that it is "the Pentagon" and not Hegseth? In general, I see a lot of common sense from the real Pentagon as opposed to the Secretary of War. I hope Westpoint will check for AI psychosis in their entrance interviews and completely forbid A…

Unfortunately, I have bad news for you.

https://www.westpoint.edu/about/modernization-plan/artificia...

Re: Anthropic drops flagship safety pledge

#574

Post by tjoff »

visarga wrote: post #493
observationist wrote: post #474

Earlier quoted context omitted.

Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind. Thus the first ultraintelligent m…

John Good's quote is pretty myopic, it assumes machines make better machines based on being "ultraintelligent" instead of learning from environment-action-outcome loop. It's the difference between "compute is all you need" and "compute+explorative feedback" is all you need. As if science and engineering comes from genius brains not from careful experiments.

Have you gotten any indication that machines won't have sensors?!

Re: Anthropic drops flagship safety pledge

#575

Post by sneilan1 »

jobs_throwaway wrote: post #554
honeycrispy wrote: post #465

Anthropic's CEO Dario has annoyed me to no end with his "AI will take all the jobs in 6 months" doomer speeches on every podcast he graces his presence with.

He's annoyed me most with the way he speaks. I'm not sure if its a tick or what but the way he'll repeat a word 10x before starting a sentence is painful to listen to.

Yes, the CEO's of these AI companies are clearly not the people who should be selling AI products. They need to be hidden away and kept behind closed doors where they can do their best work. And they need advertising companies, PR firms and better marketing tactics to try and soothe the customers.

Re: Anthropic drops flagship safety pledge

#576

Post by austinjp »

cmrdporcupine wrote: post #496
shubhamjain wrote: post #352

I was wondering if it was because of heavy-handedness of the administration, but apparently: > The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter. Their core argument is that if we have guardrails that others don't, they would be left behind in controlling the technology, and they are the "responsible ones." I honestly can't compreh…

We all made fun of Blake Lemoine and others for spending too many late nights up chatting with (ridiculously primitive by this year's standards) LLM chat bots and deciding they were sentient and trapped. But frankly I feel like the founders of Anthropic and others are victim of the same hallucination. LLMs are amazing tools. They play back & generate what we prompt them to play back, and more. Anybody who mistakes th…

I always feel this argument misses a point. SkyNet may still be a long way off, but autonomous killer drones are here. That is a bad situation my dudes.

Every step on the journey towards SkyNet is worse than the preceding step. Let's not split hairs about which step we're on: it's getting worse, and we should stop that.

Re: Anthropic drops flagship safety pledge

#577

Post by IAmGraydon »

nazgulsenpai wrote: post #551

More and more I have just come to accept that the majority of people, at least those I am exposed to in the US, don't fundamentally believe in anything. Everyt conviction has a buyout price.

You have to understand that people only believe in things and have "morals" because it either helps them get what they want or makes them feel better about themselves. Of course such a thing has a buyout price. That's human nature. Capitalism just allows it to be on display in the worst way.

Re: Anthropic drops flagship safety pledge

#578

Post by ramuel »

This was always just a marketing gimmick to try and crush competitors using "safety" and fearmongering. Reminds me a bit of "don't be evil." Convenient catchphrases and mission statements for companies in their infancy, but immediately thrown out when more money can be made.

Re: Anthropic drops flagship safety pledge

#579

Post by inigyou »

cael450 wrote: post #488
ACCount37 wrote: post #432

Earlier quoted context omitted.

That's because it is. AI is powerful and AI is perilous. Those two aren't mutually exclusive. Those follow directly from the same premise. If AI tech goes very well, it can be the greatest invention of all human history. If AI tech goes very poorly, it can be the end of human history.

Tbh, I find this argument really stupid. The word prediction machine isn’t going to destroy humanity. Sure, humans can do some dumb stuff with it, but that’s about it. Stop mistaking science fiction for science.

Humans can destroy humanity with the word prediction machine, though.

Re: Anthropic drops flagship safety pledge

#580

Post by inigyou »

SoftTalker wrote: post #530
SecretDreams wrote: post #518

Earlier quoted context omitted.

> If AI tech goes very well The IF here is doing some very heavy lifting. Last I checked, for profit companies don't have a good track record of doing what's best for humanity.

For profit companies do have a good track record of doing what's best for profit. If their AI creates a world where human intelligence, labor, and money are worthless, or where their creations take control of those things instead of them having control, that's not a very good outcome for them.

That's a great outcome for them because they will own the only thing that is still worth anything. They will own 100% of global wealth, and have 100% of global power.
Post reply on HN