Live data from Hacker News

Anthropic AI

anthropic.com

1–10 of 30 posts

Re: Anthropic AI

#2
Looking at the team seems to be all ex-openai employees and one of the cofounders worked on building gpt3. Will be exciting to see what they are working on and if it will be similar work to openai but more commercialized.

Re: Anthropic AI

#4
I can't find any mention of who currently comprises the core research team. It mentions Dario Amodei as CEO, and their listed prior work suggests some others from OpenAI may be tagging along. However, the success of this group is going to be highly dependent on the caliber of the research team, and I was hoping to see at least a few prominent researchers listed. I believe OpenAI launched with four or five notable researchers as well as close ties to academia via the AI group at Berkeley. Does anyone have further info on the research team?

Re: Anthropic AI

#8
Looks like an interesting project. The thing is, I don't think ideal qualities like "reliable, interpretable, and steerable" can really be simply added "on top of" existing deep learning systems and methods.

Much is made of GPT-3's ability to sometimes do logic or even arithmetic. But that ability is unreliable and even more spread through the whole giant model. Extracting a particular piece of specifically logical reasoning from the model is hard problem. You can do it - N-times the cost of the model. And in general, you can add extras to the basic functionality of deep neural nets (few-shot, generational, etc) but with a cost of, again, N-times the base (plus decreased reliability). But the "full" qualities mentioned initially would many-many extras-equivalent to one-shot and need to have them happen on the fly. (And one-shot is fairly easy seeming. Take a system that recognizes images by label ("red", "vehicle", etc). Show it thing X - it uses the categories thing X activates to decide whether other things are similar to thing X. Simple but there's still lots of tuning to do here).

Just to emphasize, I think they'll need something extra in the basic approach.

Re: Anthropic AI

#9

Looks like an interesting project. The thing is, I don't think ideal qualities like "reliable, interpretable, and steerable" can really be simply added "on top of" existing deep learning systems and methods. Much is made of GPT-3's ability to sometimes do logic or even arithmetic. But that ability is unreliable and even more spread through the whole giant model. Extracting a particular piece of specifically logical r…

Go check out the entire project of captum for pytorch. I assure you that gradient based explanations can be simply added to existing deep learning systems...

Re: Anthropic AI

#10
post #4

I can't find any mention of who currently comprises the core research team. It mentions Dario Amodei as CEO, and their listed prior work suggests some others from OpenAI may be tagging along. However, the success of this group is going to be highly dependent on the caliber of the research team, and I was hoping to see at least a few prominent researchers listed. I believe OpenAI launched with four or five notable res…

Chris Olah posted that he is involved.
Post reply on HN