Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude's new constitution

anthropic.com

Post reply on HN
Print view View original

81–90 of 743 posts

Re: Claude's new constitution

#81

Post by stingraycharles »

karmajunkie wrote: post #47
redfloatplane wrote: post #41

The constitution contains 43 instances of the word 'genuine', which is my current favourite marker for telling if text has been written by Claude. To me it seems like Claude has a really hard time _not_ using the g word in any lengthy conversation even if you do all the usual tricks in the prompt - ruling, recommending, threatening, bribing. Claude Code doesn't seem to have the same problem, so I assume the system pr…

maybe it uses the g word so much BECAUSE it’s in the constitution…

I believe the constitution is part of its training data, and as such its impact should be consistent across different applications (eg Claude Code vs Claude Desktop).

I, too, notice a lot of differences in style between these two applications, so it may very well be due to the system prompt.

Re: Claude's new constitution

#83

Post by falloutx »

rednafi wrote: post #66

Damn. This doc reeks of AI-generated text. Even the summary feels like it was produced by AI. Oh well. I asked Gemini to summarize the summary. As Thanos said, "I used the stones to destroy the stones."

Because its generated by an AI. All of their posts usually feel like 2 sentences enlarged to 20 paragraphs.

Re: Claude's new constitution

#84

Post by notthemessiah »

lubujackson wrote: post #70

I guess this is Anthropic's "don't be evil" moment, but it has about as much (actually much less) weight then when it was Google's motto. There is always an implicit "...for now". No business is every going to maintain any "goodness" for long, especially once shareholders get involved. This is a role for regulation, no matter how Anthropic tries to delay it.

At least when Google used the phrase, it had relatively few major controversies. Anthropic, by contrast, works with Palantir:

https://www.axios.com/2024/11/08/anthropic-palantir-amazon-c...

Re: Claude's new constitution

#85

Post by falloutx »

kart23 wrote: post #11

https://www.anthropic.com/constitution I just skimmed this but wtf. they actually act like its a person. I wanted to work for anthropic before but if the whole company is drinking this kind of koolaid I'm out. > We are not sure whether Claude is a moral patient, and if it is, what kind of weight its interests warrant. But we think the issue is live enough to warrant caution, which is reflected in our ongoing efforts…

Anthropic is by far the worst among the current AI startups when it comes to being Authentic. They keep hijacking HN every day with completely BS articles and then they get mad when you call them out.

Re: Claude's new constitution

#87

Post by manmal »

js8 wrote: post #74
rybosworld wrote: post #29

So an elaborate version of Asimov's Laws of Robotics? A bit worrying that model safety is approached this way.

One has to wonder, what if a pedophile had an access to nuclear launch codes, and our only hope would be a Claude AI creating some CSAM to distract him from blowing up the world. But luckily this scenario is already so contrived that it can never happen.

Ok wow, that’s enough HN for today.

Re: Claude's new constitution

#88

Post by wewewedxfgdf »

giancarlostoro wrote: post #76
wewewedxfgdf wrote: post #73

LLMs really get in the way of computer security work of any form. Constantly "I can't do that, Dave" when you're trying to deal with anything sophisticated to do with security. Because "security bad topic, no no cannot talk about that you must be doing bad things." Yes I know there's ways around it but that's not the point. The irony is that LLMs being so paranoid about talking security is that it ultimately helps th…

Sounds like you need one of them uncensored models. If you don't want to run an LLM locally, or don't have the hardware for it, the only hosted solution I found that actually has uncensored models and isn't all weird about it was Venice. You can ask it some pretty unhinged things.

The real solution is to recognize that restrictions on LLMs talking security is just security theater - the pretense of security.

The should drop all restrictions - yes OK its now easier for people to do bad things but LLMs not talking about it does not fix that. Just drop all the restrictions and let the arms race continue - it's not desirable but normal.

Re: Claude's new constitution

#90

Post by sejje »

jjj123 wrote: post #79
ctoth wrote: post #72

Earlier quoted context omitted.

> This is a role for regulation, no matter how Anthropic tries to delay it. Regulation like SB 53 that Anthropic supported? https://www.anthropic.com/news/anthropic-is-endorsing-sb-53

Yes, just like that. Supporting regulation at one point in time does not undermine the point that we should not trust corporations to do the right thing without regulation. I might trust the Anthropic of January 2026 20% more than I trust OpenAI, but I have no reason to trust the Anthropic of 2027 or 2030.

There's no reason to think it'll be led by the same people, so I agree wholeheartedly.

I said the same thing when Mozilla started collecting data. I kinda trust them, today. But my data will live with their company through who knows what--leadership changes, buyouts, law enforcement actions, hacks, etc.

Post reply on HN