Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meet “Claude”: Anthropic’s rival to ChatGPT

scale.com

Post reply on HN
Print view View original

91–100 of 165 posts

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#91

Post by nathias »

astrange wrote: post #67
nathias wrote: post #14

we need less censorious AIs not more ... the claim that it's somehow 'ethical' to have a guy baking in his opinions about things in a tool used globally is absurd to anyone who ever read anything about ethics

You're welcome to try GPT3 before instruction tuning. It doesn't work at all. "Uncensored" AIs especially don't work for women because they'll immediately start writing erotica.

I don't have an issue with instruction tuning, but it's disengenious to pretend the biases inherent in the instruction tuning are a good thing and 'ethics'.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#92

Post by detrites »

goodside wrote: post #83
detrites wrote: post #77

Earlier quoted context omitted.

Thanks for being here to answer questions. One possibly difficult topic others also may be interested in, after reading Claude's responses in the article, is: what does "harmless" mean? For example, if asked to help the user understand how to do something "bad", will it give the answer if they claim they want this information in order to help them write a screenplay, versus if they seem have an intent to do it? And h…

The motivation as I understand it has less to do with present-day misuse, and more to do with maintaining controllable behavior in accordance with an arbitrary, human-written “Constitution”. Anthropic is attempting to make a model that will not harm (in the unambiguous, uncontroversial sense of the word) humans even if it is superhumanly intelligent, or trusted with real-world control.

Great answer, thank you.

The issue of regarding humans as AI-persuadable entities is certainly one to be carefully considered. Indeed, if it were to occur in the truest sense, we'd never know it.

Another view is any AI we give birth to may only be constituted of what we are; we who ultimately, if imperfectly, demonstrate value for all life. In a sense, our constitution as "mostly harmless" may be AI's default.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#93

Post by topynate »

astrange wrote: post #67
nathias wrote: post #14

we need less censorious AIs not more ... the claim that it's somehow 'ethical' to have a guy baking in his opinions about things in a tool used globally is absurd to anyone who ever read anything about ethics

You're welcome to try GPT3 before instruction tuning. It doesn't work at all. "Uncensored" AIs especially don't work for women because they'll immediately start writing erotica.

GPT3 works quite well at following instructions if adequately prompted, just not as well as ChatGPT. ChatGPT was trained separately for ability to follow instructions and for harmlessness (sic). Not only is a non-moralising ChatGPT possible, one was actually created during the research process. You may also wish to know that most readers of erotica are women.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#94

Post by [deleted] »

yellow_lead wrote: post #85
goodside wrote: post #59

Earlier quoted context omitted.

I said “seems to”, which I think is a fair description. In everyday life, even a canned message is sensibly said to be aware/unaware of a particular fact without a “seems to” qualifier, but I added one to be clear I’m not asserting it has human-like thinking. Here’s Claude replying to your comment with more detail: > You make a fair point that my responses about myself are generated by a trained model and are not a t…

Even with the "Seems to" qualifier, I am arguing that it "seems not to." That said, I am being pedantic and this is just semantics - I think I understand your meaning of "seems to" as something like "'it would appear to' have understanding of..."

[deleted]

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#95

Post by spi »

anhner wrote: post #60

I'm hoping of one day running GPT3/ChatGPT on my local computer, similarly to how one can run Stable Diffusion now. I would love to have a personal conversation with these AI systems, use them as a sort of assistant, without the worry of being spied on. At the moment I can't use it as more than a glorified search engine, because of the privacy implications of running it on the cloud.

There's not much of an alternative: even if compute power gets extraordinarily cheap / models are very optimized, either you have a very, very large hard drive, or you have to use the internet for that. You just can't hope to have a model that is trained to know everything in a smallish file, the weights need to be at least as heavy as an ideally compressed version of all the things it knows (which is of course much less than the huge amount of data it is trained on, mainly due to redundancy, but still a lot)

Of course, right now you also need at least 8 super-expensive A100 GPUs and not just your laptop CPU, but maybe that's going to change eventually.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#96

Post by swhalen »

flanked-evergl wrote: post #87

> Claude feels not only safer but more fun than ChatGPT. I may be the minority here, but I really don't concern myself with ChatGPT safety and I am not entirely sure what the reason is why people are very worried about its safetly. It is safer than most things I have in my house, including a kettle, a saw, a hammer, a screwdriver, my actual PC, every kitchen appliance I have. Of course it can be misused, like any too…

I hope someone makes one of these things that has been trained without any concern for 'safety' or propriety, just for the sake of comparison.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#97

Post by M4v3R »

harvey9 wrote: post #55
logicallee wrote: post #45

Earlier quoted context omitted.

What do you mean by your second sentence?

I take that to mean they are glad because if you spoke to a human employee that way it would be seen as rude and the human would quit their job.

I still try to speak politely to ChatGPT. When the AI uprising finally happens I hope they will see that I was always nice to the AIs and don't kill me on the spot.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#98

Post by viraptor »

nathias wrote: post #14

we need less censorious AIs not more ... the claim that it's somehow 'ethical' to have a guy baking in his opinions about things in a tool used globally is absurd to anyone who ever read anything about ethics

We already had a learning AI without hard limits. Remember Microsoft's Tay? Ah, right, it was shut within days because it quickly became an asshole. (https://www.theverge.com/2016/3/24/11297050/tay-microsoft-ch...)

It's not even going to be objectively wrong a lot of the time. For example slaves are indeed a pretty efficient way to run a business. It's our limits and ethics that stops (most of) us from doing it. Without ethics, you'll likely always end up with a 4chan-bot instead of whatever you intended.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#100

Post by irthomasthomas »

LeoPanthera wrote: post #11

They say Claude is "more verbose", and claim this is a positive. I disagree. My biggest criticism of ChatGPT is that its answers are extraordinarily long and waffly. It sometimes reminds me of a scam artist trying to bamboozle me with words. I would much prefer short, concise, precise answers.

I usually prime it with a list of instructions that it should follow for the remainder of the conversation, including to be brief. And when it starts forgetting my instructions, it is time to start a fresh chat.
Post reply on HN