Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Meet “Claude”: Anthropic’s rival to ChatGPT

scale.com

Post reply on HN
Print view View original

61–70 of 165 posts

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#61

Post by Roark66 »

KRAKRISMOTT wrote: post #29
ma2rten wrote: post #20

Earlier quoted context omitted.

No, you need billions of words to train a large language model.

Assuming all human languages have a common shared semantic meaning in latent space (I am flipping cause and effect here, but our purposes it doesn't really matter), and assuming that human languages largely follow the same pattern (this assumption is based on the fact that we can trace the roots of modern languages back to the Phoenician script), it is reasonable to assume that we can fine-tune a self supervised mode…

I think you may be on to something here. For example ChatGPT is perfectly capable of "understanding" and speaking Polish while the amount of training data in this language definitely wasn't a lot. It is not as eloquent as in English, but still for a model that has not been trained for translation tasks, this is very cool.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#62

Post by anaganisk »

wheelerof4te wrote: post #42

Imagine an android connected to the vast network of information (ChatGPT-like). The android could generate various responses in real-time, just by vocalizing the approriate text. It might be clunky at first, but it's a good starting base to improve upon. The android could, for example, store common and everyday responses in it's RAM, making it semi-capable of autonomous speech. Then, it could use that information to…

Yeah I am alrwady to able to Imagine, the android welcoming me and suggesting me what I should buy with its sweet words, based on my past interactions with it.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#64

Post by cedilla »

KRAKRISMOTT wrote: post #47
cedilla wrote: post #44

Earlier quoted context omitted.

Phoenician script is the common ancestor of Latin, greek and Cyrillic script. You're probably thinking of the indo-european language family, which accounts for about 45% of native language speakers. The largest language family in the world, but not even a majority. Scripts and languages change over the course of decades, and while there are well known mechanisms to those changes, trying to deduce hieroglyphics or anc…

I am not saying that all languages have a shared structure, but from the Bayesian variational learning perspective, as long as the new data shares some structure with what the model has previously encountered, the prior training data contributes to understanding the new information i.e. few-shot . This is in the information theoretic sense, I am not stating any theories about the underlying semantics or grammar. I kn…

Is there any reason to assume any shared structure for unrelated languages though? Written language is just an encoding for information.

There is a good candidate for a test. Someone will probably already work on it. Minoan as written in Linear A has only survived in a few thousand tokens and despite thousands of man years of effort, natural intelligence has made virtually no progress in understanding it. That's still easy mode, since we know that the Minoans were in contact with speakers of indo-european and Semitic languages, and writers of hieroglyphics and phonetician script, so their written Language was probably influenced by that.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#65

Post by unnouinceput »

Al-Khwarizmi wrote: post #40
nathias wrote: post #14

we need less censorious AIs not more ... the claim that it's somehow 'ethical' to have a guy baking in his opinions about things in a tool used globally is absurd to anyone who ever read anything about ethics

My hope is on a non-American alternative. The American society seems too engulfed by puritanism to produce a less straightjacketed chatbot.

Watch the show Person of Interest (https://www.imdb.com/title/tt1839578/). Somewhere around middle of season 2 it's explained why a self-aware AI is straightjacketed. Also the series shows what happens when one is not.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#66

Post by TuringTest »

Definitely humor is in the eye of the beholder. I find the Seinfeld jokes by ChatGPT wittier and funnier than the run-of-the-mill comments created by Claude.

I don't know how well they are in character, and there's a clear repetition problem (which Claude somewhat also exhibits), but I find the format from ChatGPT more exaggerated, as expected from a comedy routine.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#67

Post by astrange »

nathias wrote: post #14

we need less censorious AIs not more ... the claim that it's somehow 'ethical' to have a guy baking in his opinions about things in a tool used globally is absurd to anyone who ever read anything about ethics

You're welcome to try GPT3 before instruction tuning. It doesn't work at all.

"Uncensored" AIs especially don't work for women because they'll immediately start writing erotica.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#69

Post by jillesvangurp »

anhner wrote: post #60

I'm hoping of one day running GPT3/ChatGPT on my local computer, similarly to how one can run Stable Diffusion now. I would love to have a personal conversation with these AI systems, use them as a sort of assistant, without the worry of being spied on. At the moment I can't use it as more than a glorified search engine, because of the privacy implications of running it on the cloud.

There will always be this uncomfortable balance between need to know information to be useful being essentially the same as everything an adversary would need to really act against you.

With something like chat gpt being plugged into some voice assistant thing and having access to all your documents, emails, and other content, you could imagine having conversations about work content, content creation, calendar management, etc. Basically it would become like a secretary that is able to write letters based on your input, manage your calendar, etc. It could be pro-active and remind you about things, summarize incoming messages, search through your documents, message history, etc.

That's where AI becomes really useful. But the issue of trust is a big one. I don't think a lot of this requires a lot of breakthroughs either just a lot of integration work and engineering. Chat gpt is more a proof of concept than a well integrated thing at this point. It basically is running in isolation and it's only window to the world is chat. Changing that should not be that hard. Running things locally might help with this but it may not be a hard requirement for this. All depends on how useful this is.

Re: Meet “Claude”: Anthropic’s rival to ChatGPT

#70

Post by Raphaellll »

astrange wrote: post #54
code51 wrote: post #15

Earlier quoted context omitted.

You are able to prompt ChatGPT to be concise, you know? They set a default and showed it to the world. It is up to you to tune it according to your preference.

IIRC the ChatGPT paper actually says the verbosity is an unintended effect of the human raters preferring longer/more detailed answers. Long answers from GPT are unusually obnoxious because of a way the decoder works; it emits words with a much more constant rate of perplexity than human text does (this is how GPT-vs-human detectors work) which makes it sound stuffy and monotone.

There is a paper?
Post reply on HN