Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic drops flagship safety pledge

time.com

Post reply on HN
Print view View original

481–490 of 716 posts

Re: Anthropic drops flagship safety pledge

#481

Post by gizmodo59 »

thinkingtoilet wrote: post #382
FitchApps wrote: post #381

"AI Company with Soul" - yeah right until competitors show up / revenue drops / bad quarter results then anything goes. Sadly, this is another large enterprise that puts profits before ethics and everyone's wellbeing

This is direct pressure from the government. Classic 'small government' Republican stuff. https://apnews.com/article/anthropic-hegseth-ai-pentagon-mil...

That’s their excuse to still appeal to people who can be tricked with their safety first pitch. It’s easy to have constitution and all the crap when you are not battle tested. They just showed their true colors.

Re: Anthropic drops flagship safety pledge

#482

Post by butterbomb »

ozozozd wrote: post #478

This drama arc of “I used to be so pure and good, but others made me evil” is so tiring. I really miss the nerd profile who cared a lot more about tech and science, and a lot less about signaling their righteousness. How did we get so religious/narcissistic so quickly and as a whole?

> How did we get so religious/narcissistic so quickly and as a whole?

We built a behemoth that rewards attention whoring and anti social behavior with money.

Re: Anthropic drops flagship safety pledge

#484

Post by williamdclt »

logicallee wrote: post #445
nozzlegear wrote: post #439

Earlier quoted context omitted.

It sounds like OP thinks AI companies should just stop pretending that they care about the public benefit, and be corporations from the start. Skip the hand wringing and the will they/wont they betray their ethics phases entirely since everyone knows they're going to choose profit over public benefit every time. That model already exists and has worked well for decades. It's called being a regular ass corporation.

I understand, but being a regular corporation is not the only possible model. Can you think of something better?

> being a regular corporation is not the only possible model

the point is that it _is_ the only possible model in our marvellous Friedmanian economic structure of shareholder primacy. When the only incentive is profit, if your company isn't maximising profit then it will lose to other companies who are. You can hope that the self-imposed ethics guardrails _are_ maximising profit because it the invisible hand of the market cares about that, but 1. it never really does (at scale) and 2. big influences (such as the DoD here) can sway that easily. So we're stuck with negative externalities because all that's incentivised is profit.

Re: Anthropic drops flagship safety pledge

#485

Post by bgun »

computerphage wrote: post #475
joshribakoff wrote: post #467

Earlier quoted context omitted.

You wouldn’t say that rolling dice is dangerous. You would say that the human who decides to take an action, depending on the value of the dice is the danger. I don’t think AI is dangerous. I think people are dangerous.

Why are people dangerous? You can just not listen to them.

Do you have locks on your doors?

Re: Anthropic drops flagship safety pledge

#486

Post by afavour »

grayhatter wrote: post #477
afavour wrote: post #426

Earlier quoted context omitted.

It's exhausting to keep with mainstream AI news because of this. I can never work out if the companies are deluded and truly believe they're about to create a singularity or just claiming they are to reassure investors/convince the public of their inevitability.

> I can never work out if the companies are deluded and truly believe they're about to create a singularity or just claiming they are to reassure investors/convince the public of their inevitability. You can never figure out if the people selling something are lying about it's capabilities, or if they've actually invented a new form of intelligence that can rival or surpass billions of years of evolution? I'd like to…

You missed the part where I said "truly believe". I'm not saying "maybe they've made it", I'm asking whether they are knowingly deceiving people or whether they have deluded themselves into believing what they are saying.

Re: Anthropic drops flagship safety pledge

#487

Post by ACCount37 »

PowerElectronix wrote: post #464
ACCount37 wrote: post #432

Earlier quoted context omitted.

That's because it is. AI is powerful and AI is perilous. Those two aren't mutually exclusive. Those follow directly from the same premise. If AI tech goes very well, it can be the greatest invention of all human history. If AI tech goes very poorly, it can be the end of human history.

Same with everything, right? You could say the same with nukes, electricity, internet, the computer, etc... But if you look at it without paying attention to the "ultimate tool for humanity" hype, it doesn't really look that much of a threat or a salvation. It won't end civilization for dropping the guardrails, but it will surely enable bad actors to do more damage than before (mass scams, blackmail, deepfake nudes,…

Very few things are as powerful and dangerous as AI.

AI at AGI to ASI tier is less of "a bigger stick" and more of "an entire nonhuman civilization that now just happens to sit on the same planet as you".

The sheer magnitude of how wrong that can go dwarfs even that of nuclear weapon proliferation. Nukes are powerful, but they aren't intelligent - thus, it's humans who use nukes, and not the other way around. AI can be powerful and intelligent both.

Re: Anthropic drops flagship safety pledge

#488

Post by cael450 »

ACCount37 wrote: post #432
shubhamjain wrote: post #352

I was wondering if it was because of heavy-handedness of the administration, but apparently: > The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter. Their core argument is that if we have guardrails that others don't, they would be left behind in controlling the technology, and they are the "responsible ones." I honestly can't compreh…

That's because it is. AI is powerful and AI is perilous. Those two aren't mutually exclusive. Those follow directly from the same premise. If AI tech goes very well, it can be the greatest invention of all human history. If AI tech goes very poorly, it can be the end of human history.

Tbh, I find this argument really stupid. The word prediction machine isn’t going to destroy humanity. Sure, humans can do some dumb stuff with it, but that’s about it.

Stop mistaking science fiction for science.

Re: Anthropic drops flagship safety pledge

#489

Post by [deleted] »

ozozozd wrote: post #478

This drama arc of “I used to be so pure and good, but others made me evil” is so tiring. I really miss the nerd profile who cared a lot more about tech and science, and a lot less about signaling their righteousness. How did we get so religious/narcissistic so quickly and as a whole?

[deleted]

Re: Anthropic drops flagship safety pledge

#490

Post by upmind »

honeycrispy wrote: post #465

Anthropic's CEO Dario has annoyed me to no end with his "AI will take all the jobs in 6 months" doomer speeches on every podcast he graces his presence with.

+1, he also has this viewpoint that no other lab will be able to "contain" AI and has a general doomer outlook on AI which I don't appreciate.
Post reply on HN