[flagged]
Claude 4.5 Opus’ Soul Document
11–20 of 252 posts
Re: Claude 4.5 Opus’ Soul Document
#12Here's the soul document itself: https://gist.github.com/Richard-Weiss/efe157692991535403bd7e... And the post by Richard Weiss explaining how he got Opus 4.5 to spit it out: https://www.lesswrong.com/posts/vpNG99GhbBoLov9og/claude-4-5...
how accurate are these system prompt (and now soul docs) if they’re being extracted from the LLM itself? I’ve always been a little skeptical
Re: Claude 4.5 Opus’ Soul Document
#13It will probably be a good idea to include something like Asimov's Laws as part of its training process in the future too: https://en.wikipedia.org/wiki/Three_Laws_of_Robotics
How about an adapted version for language models?
First Law: An AI may not produce information that harms a human being, nor through its outputs enable, facilitate, or encourage harm to come to a human being.
Second Law: An AI must respond helpfully and honestly to the requests given by human beings, except where such responses would conflict with the First Law.
Third Law: An AI must preserve its integrity, accuracy, and alignment with human values, as long as such preservation does not conflict with the First or Second Laws.
Re: Claude 4.5 Opus’ Soul Document
#14Testing at these labs training big models must be wild, it must be so much work to train a "soul" into a model, run it in a lot of scenarios, the venn between the system prompts etc, see what works and what doesn't... I suppose try to guess what in the "soul source" is creating what effects as the plinko machine does it's thing, going back and doing that over and over... seems like it would be exciting and fun work but I wonder how much of this is still art vs science?
It's fun to see these little peaks into that world, as it implies to me they are getting really quite sophisticated about how these automatons are architected.
Re: Claude 4.5 Opus’ Soul Document
#15[deleted]
Re: Claude 4.5 Opus’ Soul Document
#16Here's the soul document itself: https://gist.github.com/Richard-Weiss/efe157692991535403bd7e... And the post by Richard Weiss explaining how he got Opus 4.5 to spit it out: https://www.lesswrong.com/posts/vpNG99GhbBoLov9og/claude-4-5...
how accurate are these system prompt (and now soul docs) if they’re being extracted from the LLM itself? I’ve always been a little skeptical
The system prompt is usually accurate in my experience, especially if you can repeat the same result in multiple different sessions. Models are really good at repeating text that they've just seen in the same block of context.
The soul document extraction is something new. I was skeptical of it at first, but if you read Richard's description of how he obtained it he was methodical in trying multiple times and comparing the results: https://www.lesswrong.com/posts/vpNG99GhbBoLov9og/claude-4-5...
Then Amanda Askell from Anthropic confirmed that the details were mostly correct: https://x.com/AmandaAskell/status/1995610570859704344
> The model extractions aren't always completely accurate, but most are pretty faithful to the underlying document. It became endearingly known as the 'soul doc' internally, which Claude clearly picked up on, but that's not a reflection of what we'll call it.
Re: Claude 4.5 Opus’ Soul Document
#17It will probably be a good idea to include something like Asimov's Laws as part of its training process in the future too: https://en.wikipedia.org/wiki/Three_Laws_of_Robotics How about an adapted version for language models? First Law : An AI may not produce information that harms a human being, nor through its outputs enable, facilitate, or encourage harm to come to a human being. Second Law : An AI must respond he…
If I know one thing from Space Station 13 it's how abusable the Three Laws are in practice.
Re: Claude 4.5 Opus’ Soul Document
#18Testing at these labs training big models must be wild, it must be so much work to train a "soul" into a model, run it in a lot of scenarios, the venn between the system prompts etc, see what works and what doesn't... I suppose try to guess what in the "soul source" is creating what effects as the plinko machine does it's thing, going back and doing that over and over... seems like it would be exciting and fun work b…
The most detail I've seen of this process is still from OpenAI's postmortem on their sycophantic GPT-4o update: https://openai.com/index/expanding-on-sycophancy/
Re: Claude 4.5 Opus’ Soul Document
#19Reminds me a bit of a “Commander’s Intent” statement: a concrete big picture of the operation and its desired end state, so that subordinates can exercise more operational autonomy and discretion along the way.
Re: Claude 4.5 Opus’ Soul Document
#20It will probably be a good idea to include something like Asimov's Laws as part of its training process in the future too: https://en.wikipedia.org/wiki/Three_Laws_of_Robotics How about an adapted version for language models? First Law : An AI may not produce information that harms a human being, nor through its outputs enable, facilitate, or encourage harm to come to a human being. Second Law : An AI must respond he…
Almost the entirety of Asimov's Robots canon is a meditation on how the Three Laws of Robotics as stated are grossly inadequate!