Anthropic’s $5B, 4-year plan to take on OpenAI
techcrunch.com
Anthropic’s $5B, 4-year plan to take on OpenAI
1–10 of 504 posts
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#2This is a lot of money going into compute.
I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#34 years ?!?
That’s like a century in AI-dog years. Who knows how the world will be by then.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#4What is interesting is that a lot of these models have impressive papers and specs, but when they are released to actual users, they are underwhelming compared to ChatGPT.
Rather than another closed model, I would love for a non-profit/company to push models that can be run on consumer hardware.
The Facebook Llama models are interesting not because they are better than ChatGPT, but that I can run them on my own computer.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#5Anthropic’s Claude LLM is pretty interesting. In many ways it feels much more limited than GPT4. However, it is suspiciously good at a few edge-case code generation tasks (can’t go into details) that makes me wonder where it got its training data from. It also seems to be much less prone to hallucinating APIs and modules, preferring instead to switch back to natural language and describe the task without pretending it has a functioning solution handy.
Worth keeping an eye on for sure.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#6>“tens of thousands of GPUs.”
I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go
GPUs presumably come with a lot of unneeded stuff to play crysis etc
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#7This is a lot of money going into compute. I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.
> [2008] France has been given the green light by the European Commission for a $152 million government grant for a consortium building a European rival to U.S. internet search giant Google.
I don't think government funding to compete with private businesses works well
https://www.hollywoodreporter.com/business/business-news/ec-...
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#8This is a lot of money going into compute. I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.
Sure, let's make an EU commercial LLM. Let's start by scraping all the Francophone internet. Then let's remove all the PII data and potentially PII-data. Easy-peasy.
Then let's train our network so as not to spew out or make up PII data - easy peasy
Then let's make it able to delete PII data that it has inadvertedly collected on request. Simultaneously it should be recording all the conversations for safety reasons. that must be possible somehow
And let's make sure it never impersonates or makes up defamatory content - that must be super easy.
And let's make it explain itself. But explain truthfully, by giving an oath, not like ChatGPT that likes making things up.
Looks very doable to me
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#9Anthropic’s Claude LLM is pretty interesting. In many ways it feels much more limited than GPT4. However, it is suspiciously good at a few edge-case code generation tasks (can’t go into details) that makes me wonder where it got its training data from. It also seems to be much less prone to hallucinating APIs and modules, preferring instead to switch back to natural language and describe the task without pretending i…
I know you said no details, but can you at least share a little bit more about Claude LLM's code generation?
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#10This is a lot of money going into compute. I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.
[flagged]