[dead]
Anthropic’s $5B, 4-year plan to take on OpenAI
11–20 of 504 posts
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#12>“tens of thousands of GPUs.” I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go GPUs presumably come with a lot of unneeded stuff to play crysis etc
Do GPUs give you more flexibility to take different approaches? Maybe they’re paying extra for optionality. Or maybe (most likely) TechCrunch is using the term “GPU” imprecisely.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#13Would FTX customers get actual shares in a bankruptcy or would the shares be sold? Seems like a really good deal to get the shares in a promising startup.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#14>“tens of thousands of GPUs.” I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go GPUs presumably come with a lot of unneeded stuff to play crysis etc
the GPUs these guys would be using are not the same ones you are using to play crysis, we're talking more about this kind of purpose-built thing: https://www.nvidia.com/en-us/data-center/a100/
It's become more of a term for highly parallel processor units in general, one which NVidia encourages because it ties their product offering together
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#15>“tens of thousands of GPUs.” I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go GPUs presumably come with a lot of unneeded stuff to play crysis etc
There are AI / datacenter focused GPUs (like the A100, H100 etc.). They do not have any graphics rendering circuitry.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#16This is a lot of money going into compute. I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.
Sure, let's make an EU commercial LLM. Let's start by scraping all the Francophone internet. Then let's remove all the PII data and potentially PII-data. Easy-peasy. Then let's train our network so as not to spew out or make up PII data - easy peasy Then let's make it able to delete PII data that it has inadvertedly collected on request. Simultaneously it should be recording all the conversations for safety reasons.…
BLOOM has been trained on a 3M€ grant from French research agencies CNRS and GENCI.
Doesn’t have any of the constraints you’re talking about.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#17This is a lot of money going into compute. I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.
France paid for Bloom: https://www.technologyreview.com/2022/07/12/1055817/inside-a...
It hasn’t been very impressive (undertrained I believe).
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#18Is there a large barrier to entry? I thought that the costs of training, while large, were only a few million so not insurmountable, and the technology is pretty well understood. If this is true it's hard to understand what they'd need $300 million for, and also if there's no moat why they would command a "billions" valuation.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#19This is a lot of money going into compute. I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.
> [2008] France has been given the green light by the European Commission for a $152 million government grant for a consortium building a European rival to U.S. internet search giant Google. I don't think government funding to compete with private businesses works well https://www.hollywoodreporter.com/business/business-news/ec-...
Governments that think they can innovate through consortiums. That's either ignorance or pork barrel politics. Either way it's a sad waste of tax payer money.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#204 years ?!? That’s like a century in AI-dog years. Who knows how the world will be by then.
[flagged]