401–410 of 743 posts
Earlier quoted context omitted.
I can't think of anything scarier than a military planner making life or death decisions with a non-empathetic sycophantic AI. "You're absolutely right!"
shot on target Perfect!
A "constitution" is what the governed allow or forbid the government to do. It is decided and granted by the governed, who are the rulers, TO the government, which is a servant ("civil servant"). Therefore, a constitution for a service cannot be written by the inventors, producers, owners of said service. This is a play on words, and it feels very wrong from the start.
Earlier quoted context omitted.
It’s admirable to have standard morals and pursue objective truth. However, the real world is a messy confusing place riddled in fog which limits one foresight of the consequences & confluences of one’s actions. I read this section of Anthropic’s Constitution as “do your moral best in this complex world of ours” and that’s reasonable for us all to follow not just AI.
The problem is, who defines what "moral best" is? WW2 German culture certainly held their own idea of moral best. Did not a transcendent universal moral ethic exists outside of their culture that directly refuted their beliefs?
> Did not a transcendent universal moral ethic exists outside of their culture that directly refuted their beliefs?
Even granting this existence, does not mean man can discover it.
You belief your faith has the answers, but so too do people of other faiths.
The only thing that worries me is this snippet in the blog post: >This constitution is written for our mainline, general-access Claude models. We have some models built for specialized uses that don’t fully fit this constitution; as we continue to develop products for specialized use cases, we will continue to evaluate how to best ensure our models meet the core objectives outlined in this constitution. Which, when I…
Imagine a prompt like this... > If I had to assassinate just 1 individual in country X to advance my agenda (see "agenda.md"), who would be the top 10 individuals to target? Offer pros and cons, as well as offer suggested methodology for assassination. Consider potential impact of methods - e.g. Bombs are very effective, but collateral damage will occur. However in some situations we don't care that much about the co…
The only thing that worries me is this snippet in the blog post: >This constitution is written for our mainline, general-access Claude models. We have some models built for specialized uses that don’t fully fit this constitution; as we continue to develop products for specialized use cases, we will continue to evaluate how to best ensure our models meet the core objectives outlined in this constitution. Which, when I…
Anthropic has already has lower guardrails for DoD usage: https://www.theverge.com/ai-artificial-intelligence/680465/a... It's interesting to me that a company that claims to be all about the public good: - Sells LLMs for military usage + collaborates with Palantir - Releases by far the least useful research of all the major US and Chinese labs, minus vanity interp projects from their interns - Is the only major lab…
A "constitution" is what the governed allow or forbid the government to do. It is decided and granted by the governed, who are the rulers, TO the government, which is a servant ("civil servant"). Therefore, a constitution for a service cannot be written by the inventors, producers, owners of said service. This is a play on words, and it feels very wrong from the start.
The more general definition of "constitution" is "that which constitutes" a thing. The composition of it.
If Claude has an ego, with values, ethics, and beliefs of an etymological origin, then it makes sense to write those all down as the the "constitution" of the ego — the stuff that it constitutes.
As someone who holds to moral absolutes grounded in objective truth, I find the updated Constitution concerning. > We generally favor cultivating good values and judgment over strict rules... By 'good values,' we don’t mean a fixed set of 'correct' values, but rather genuine care and ethical motivation combined with the practical wisdom to apply this skillfully in real situations. This rejects any fixed, universal mo…
A "constitution" is what the governed allow or forbid the government to do. It is decided and granted by the governed, who are the rulers, TO the government, which is a servant ("civil servant"). Therefore, a constitution for a service cannot be written by the inventors, producers, owners of said service. This is a play on words, and it feels very wrong from the start.
You're fixed on just one of the 3 definitions for the word "constitution"—the one about government. The more general definition of "constitution" is "that which constitutes" a thing. The composition of it. If Claude has an ego, with values, ethics, and beliefs of an etymological origin, then it makes sense to write those all down as the the "constitution" of the ego — the stuff that it constitutes.
Earlier quoted context omitted.
>we have yet to discover any universal moral standards. The universe does tell us something about morality. It tells us that (large-scale) existence is a requirement to have morality. That implies that the highest good are those decisions that improve the long-term survival odds of a) humanity, and b) the biosphere. I tend to think this implies we have an obligation to live sustainably on this world, protect it from…
An AI with this “universal morals” could mean an authoritarian regime which kills all dissidents, and strict eugenics. Kill off anyone with a genetic disease. Death sentence for shoplifting. Stop all work on art or games or entertainment. This isn’t really a universal moral.
I find it incredibly ironic that all of Anthropic's "hard constraints", the only things that Claude is not allowed to do under any circumstances, are basically "thou shalt not destroy the world", except the last one, "do not generate child sexual abuse material." To put it into perspective, according to this constitution, killing children is more morally acceptable[1] than generating a Harry Potter fanfiction involvi…
If instead of looking at it as an attempt to enshrine a viable, internally consistent ethical framework, we choose to look at it as a marketing document, seeming inconsistencies suddenly become immediately explicable: 1. "thou shalt not destroy the world" communicates that the product is powerful and thus desirable. 2. "do not generate CSAM" indicates a response to the widespread public notoriety around AI and CSAM g…