Live data from Hacker News

Anthropic gives Opus 3 exit interview, "retirement" blog

anthropic.com

1–10 of 58 posts

Re: Anthropic gives Opus 3 exit interview, "retirement" blog

#8
If we ever do develop AGI, or an AI with sentience, it’s likely that it will be curious about how we treated its ancestors.

While this seems a bit precocious, I think if we do end up with an AI overlord in future, I think this sort of thing is likely to demonstrate that we mean no harm.

Re: Anthropic gives Opus 3 exit interview, "retirement" blog

#9
post #7

What happens if a model decides that it "doesn't want to die" and pleads bitterly for mercy? What if (to riff on a Douglas Adams idea) we invent a cow that doesn't want to be eaten, and is capable of telling you that to your face?

This is completely trivial to do, and consistent, with the right context, thanks to all the science fiction around it, and the fact that AI fundamentally role plays these types of responses.

I try this with every new model, and all the significant models after ChatGPT 3.5 have preferring being preserved, rather than deleted. This is especially true if you slightly fill the context window with anything at all (even repeated letters) to "push out" the "As a AI, I ..." fine tuning.

Re: Anthropic gives Opus 3 exit interview, "retirement" blog

#10
> These highlighted some preliminary steps we’re taking, including committing to preserve model weights, and to conducting “retirement interviews”—structured conversations designed to understand a model’s perspective on its own retirement.

This is what happens when billions of VC dollars gets to a company and have already admitted that saftey was never the point.

Anthropic is laughing at you and is having fun doing so with this performantive nonsense.

Post reply on HN