Gambling with our lives: AI researcher quits Anthropic with warning about safety

Post by 568236at » Wed, Sep 09, 2026, 10:42 AM UTC

RandomLensman wrote: post #55

brunorsini wrote: post #37

I particularly like the last point he makes here: Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. It's interesting to see so much hate towards creators who use AI to make almost any type of creative work. At least these are humans using it as "controllable tools". Nuclear-powered b…

> Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources. Is the idea here that no field needs experiments and data anymore (which can take a lot of time) to be revolutinized and just "thinking" would be enough? How would an AI itself own anything?

Post by ralfd » Wed, Sep 09, 2026, 10:49 AM UTC

pjc50 wrote: post #27

dotancohen wrote: post #18

Earlier quoted context omitted.

Or he believes that other labs might get there first, and he is working to counter that threat. This is the Manhattan Project again.

How exactly does that work? The nuclear system of MAD relies on physical threat, lab A achieving ASI (artificial scary intelligence) does not prevent lab B achieving it. I would like everyone involved to be a lot clearer about their threat models, with plausible series of clearly linked steps, rather than just sounding like a Vernor Vinge novel.

Post by ralfd » Wed, Sep 09, 2026, 10:54 AM UTC

cranx wrote: post #50

At this point I feel like the boy who cried wolf is an ai researcher. Yes super intelligence could be dangerous. However, is the story a PR stunt or real? Well…

Post by glimshe » Wed, Sep 09, 2026, 10:58 AM UTC

Jackpillar wrote: post #23

glimshe wrote: post #5

What do people feel about this in China? Even if their models are well behind, they are not years behind. If we restrain US companies, assuming that is desirable, it would do nothing to deter China's and AI-pocalypse would come anyway in short notice.

You act as if Chinas Ai labs exist in the same (non-existent) regulatory framework as US labs and that they're also helmed by a similar small gaggle of psychopathic egomaniacs who are richer than god. Have you considered that perhaps Chinas labs don't share the race to the bottom technological/economic death spiral?

Post by [deleted] » Wed, Sep 09, 2026, 11:04 AM UTC

MrThoughtful wrote: post #25

Why would AI wipe us out? We have not wiped out apes, ants, and most other species. We even have discussions about how to actively save them from extinction.