Live data from Hacker News

Anthropic drops flagship safety pledge

time.com

561–570 of 716 posts

Re: Anthropic drops flagship safety pledge

#563

I was wondering if it was because of heavy-handedness of the administration, but apparently: > The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter. Their core argument is that if we have guardrails that others don't, they would be left behind in controlling the technology, and they are the "responsible ones." I honestly can't compreh…

I wonder if it stems from any of the "AI uprising" stories where humanity is viewed as the cancer to be eradicated.

Re: Anthropic drops flagship safety pledge

#564

Earlier quoted context omitted.

That's because it is. AI is powerful and AI is perilous. Those two aren't mutually exclusive. Those follow directly from the same premise. If AI tech goes very well, it can be the greatest invention of all human history. If AI tech goes very poorly, it can be the end of human history.

Tbh, I find this argument really stupid. The word prediction machine isn’t going to destroy humanity. Sure, humans can do some dumb stuff with it, but that’s about it. Stop mistaking science fiction for science.

Yeah some of the rhetoric in this thread evidences how huge this hype bubble has become. These people believe in a reality that is not the same one we're living in.

Re: Anthropic drops flagship safety pledge

#565

Anthropic's CEO Dario has annoyed me to no end with his "AI will take all the jobs in 6 months" doomer speeches on every podcast he graces his presence with.

I don't understand why some of these AI companies check their egos at the door and hire public relations companies. Yes, I understand they are changing the world but customers do not open their wallets when they are scared. Very few people I know are as avant-guarde as I am with AI, but, most people look at these new technologies and simply feel fear. Why pay for something that will replace you?

Re: Anthropic drops flagship safety pledge

#566

I was wondering if it was because of heavy-handedness of the administration, but apparently: > The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter. Their core argument is that if we have guardrails that others don't, they would be left behind in controlling the technology, and they are the "responsible ones." I honestly can't compreh…

> Every frontier tech company is convinced that the tech they are working towards is as humanity-useful as a cure for cancer, and yet as dangerous as nuclear weapons.

Amd they alone are responsible enough to govern it.

Re: Anthropic drops flagship safety pledge

#567

I was wondering if it was because of heavy-handedness of the administration, but apparently: > The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter. Their core argument is that if we have guardrails that others don't, they would be left behind in controlling the technology, and they are the "responsible ones." I honestly can't compreh…

I wonder if it stems from any of the "AI uprising" stories where humanity is viewed as the cancer to be eradicated.

It's absolutely wild that the Big Moral Question of our time is informed as much by mid-20th-century pop science fiction as it is by a existing paradigm from academia or genuine reckoning with the technology itself.

If anything that makes me more hopeful and not less. It's asking too much that major decisionmakers, even expert/technical/SV-backed ones, really understand the risks with any new technology, and it always has been.

To take an example: our current mostly-secure internet authentication and commerce world was won as a hard-fought battle in the trenches. The Tech CEOs rushed ahead into the brave new world and dropped the ball, because while "people" were telling them the risks they couldn't really understand them.

But now? Well, they all saw War Games growing up. They kinda get it in the way that they weren't ever going to grok SQL injection or Phishing.

Re: Anthropic drops flagship safety pledge

#568

I was wondering if it was because of heavy-handedness of the administration, but apparently: > The policy change is separate and unrelated to Anthropic’s discussions with the Pentagon, according to a source familiar with the matter. Their core argument is that if we have guardrails that others don't, they would be left behind in controlling the technology, and they are the "responsible ones." I honestly can't compreh…

That's because it is. AI is powerful and AI is perilous. Those two aren't mutually exclusive. Those follow directly from the same premise. If AI tech goes very well, it can be the greatest invention of all human history. If AI tech goes very poorly, it can be the end of human history.

> If AI tech goes very poorly, it can be the end of human history.

"Just unplug the goddamn thing!"

Also consider if something is so bad it makes you wince or cringe, then your adversaries are prepared to use it.

Re: Anthropic drops flagship safety pledge

#569

Earlier quoted context omitted.

That's because it is. AI is powerful and AI is perilous. Those two aren't mutually exclusive. Those follow directly from the same premise. If AI tech goes very well, it can be the greatest invention of all human history. If AI tech goes very poorly, it can be the end of human history.

> If AI tech goes very poorly, it can be the end of human history. "Just unplug the goddamn thing!" Also consider if something is so bad it makes you wince or cringe, then your adversaries are prepared to use it.

Which plug do I unplug to get my job back?

Re: Anthropic drops flagship safety pledge

#570
post #510

Earlier quoted context omitted.

Maybe ultraintelligence is having an improved environment-action-outcome loop. Maybe that's all intelligence really is

I've noticed this core philosophical difference in certain geographically associated peoples. There is a group of people who think AI is going to ruin the world because they think they themselves (or their superiors) would ruin the world. There is a group of people who think AI is going to save the world because they think they themselves (or their superiors) would save the world. Kind of funny to me that the former…

You’re just describing authoritarian vs non-authoritarian mindsets.
Post reply on HN