The constitution contains 43 instances of the word 'genuine', which is my current favourite marker for telling if text has been written by Claude. To me it seems like Claude has a really hard time _not_ using the g word in any lengthy conversation even if you do all the usual tricks in the prompt - ruling, recommending, threatening, bribing. Claude Code doesn't seem to have the same problem, so I assume the system prompt for Claude also contains the word a couple of times, while Claude Code may not. There's something ironic about the word 'genuine' being the marker for AI-written text...
Claude's new constitution
41–50 of 743 posts
Re: Claude's new constitution
#42Anthropic posted an AMA style interview with Amanda Askell, the primary author of this document, recently on their YouTube channel.
It gives a bit of context about some of the decisions and reasoning behind the constitution: https://www.youtube.com/watch?v=I9aGC6Ui3eE
Re: Claude's new constitution
#43I have to wonder if they really believe half this stuff, or just think it has a positive impact on Claude's behaviour. If it's the latter I suppose they can never admit it, because that information would make its way into future training data. They can never break character!
Re: Claude's new constitution
#44https://www.anthropic.com/constitution I just skimmed this but wtf. they actually act like its a person. I wanted to work for anthropic before but if the whole company is drinking this kind of koolaid I'm out. > We are not sure whether Claude is a moral patient, and if it is, what kind of weight its interests warrant. But we think the issue is live enough to warrant caution, which is reflected in our ongoing efforts…
Their top people have made public statements about AI ethics specifically opining about how machines must not be mistreated and how these LLMs may be experiencing distress already. In other words, not ethics on how to treat humans, ethics on how to properly groom and care for the mainframe queen. The cups of Koolaid have been empty for a while.
This book (from a philosophy professor AFAIK unaffiliated with any AI company) makes what I find a pretty compelling case that it's correct to be uncertain today about what if anything an AI might experience: https://faculty.ucr.edu/~eschwitz/SchwitzPapers/AIConsciousn...
From the folks who think this is obviously ridiculous, I'd like to hear where Schwitzgebel is missing something obvious.
Re: Claude's new constitution
#45The 'Broad Safety' guideline seems vague at first, but it might be beneficial to incorporate user feedback loops where the AI adjusts based on real-world outcomes. This could enhance its adaptability and ethics over time, rather than depending solely on the initial constitution.
Re: Claude's new constitution
#46I don't understand what this is really about. Is this: - A) legal CYA: "see! we told the models to be good, and we even asked nicely!"? - B) marketing department rebrand of a system prompt - C) a PR stunt to suggest that the models are way more human-like than they actually are Really not sure what I'm even looking at. They say: "The constitution is a crucial part of our model training process, and its content direct…
This is the same company framing their research papers in a way to make the public believe LLMs are capable of blackmailing people to ensure their personal survival.
They have an excellent product, but they're relentless with the hype.
Re: Claude's new constitution
#47The constitution contains 43 instances of the word 'genuine', which is my current favourite marker for telling if text has been written by Claude. To me it seems like Claude has a really hard time _not_ using the g word in any lengthy conversation even if you do all the usual tricks in the prompt - ruling, recommending, threatening, bribing. Claude Code doesn't seem to have the same problem, so I assume the system pr…
maybe it uses the g word so much BECAUSE it’s in the constitution…
Re: Claude's new constitution
#48Earlier quoted context omitted.
It's neither of those things. The answer is in your quoted sentence. "model training"
Right, I'm saying "model training" is vague enough that I have no idea what Claude actually does with this document. Edit: This helps: https://arxiv.org/abs/2212.08073
[deleted]
Re: Claude's new constitution
#49The constitution contains 43 instances of the word 'genuine', which is my current favourite marker for telling if text has been written by Claude. To me it seems like Claude has a really hard time _not_ using the g word in any lengthy conversation even if you do all the usual tricks in the prompt - ruling, recommending, threatening, bribing. Claude Code doesn't seem to have the same problem, so I assume the system pr…
You are probably right but without all the context here one might counter that the concept of authenticity should feature predominantly in this kind of document regardless. And using a consistent term is probably the advisable style as well: we probably don't need "constitution" writers with a thesaurus nearby right?
Re: Claude's new constitution
#50The constitution contains 43 instances of the word 'genuine', which is my current favourite marker for telling if text has been written by Claude. To me it seems like Claude has a really hard time _not_ using the g word in any lengthy conversation even if you do all the usual tricks in the prompt - ruling, recommending, threatening, bribing. Claude Code doesn't seem to have the same problem, so I assume the system pr…
maybe it uses the g word so much BECAUSE it’s in the constitution…
I expect they co-authored the constitution and other prior 'foundational documents' with Claude, so it's probably a chicken-and-egg thing.