Earlier quoted context omitted.
the GPUs these guys would be using are not the same ones you are using to play crysis, we're talking more about this kind of purpose-built thing: https://www.nvidia.com/en-us/data-center/a100/ It's become more of a term for highly parallel processor units in general, one which NVidia encourages because it ties their product offering together
True. I guess those are almost ASICs in a way just with gpu flavour interface
Anthropic’s $5B, 4-year plan to take on OpenAI
101–110 of 504 posts
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#102Earlier quoted context omitted.
I think I’ve used it so much that a sentence in I assumed it was ChatGPT. It has a certain way of speaking.
Why the downvotes? HN is funny...I spent a portion of my life giving HN users a free glimpse of ChatGPT...and I get downvoted + flagged. ChatGPT might actually be more objective, and less passive-aggressive!
https://news.ycombinator.com/item?id=35210503
Everyone has access to ChatGPT, there's no need for you to "give a free glimpse".
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#103>“tens of thousands of GPUs.” I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go GPUs presumably come with a lot of unneeded stuff to play crysis etc
There are AI / datacenter focused GPUs (like the A100, H100 etc.). They do not have any graphics rendering circuitry.
What? Not having a display output is not the same as not having graphics rendering circuitry. Here's vulkaninfo from an A100 box: https://gist.github.com/eiz/c1c3e1bd99341e11e8a4acdee7ae4cb4
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#104AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…
Correct. Stability.ai (Stable Diffusion), Apple (Won't be surprising to see them announce on-device LLMs with Apple Silicon support), Meta (LLaMa), etc are already at the bottom and at the finish line with their AI models given for free. O̶p̶e̶n̶AI.com will eventually have to raise their prices which is bad news for businesses not making enough money and still are sitting on their APIs as O̶p̶e̶n̶AI.com themselves ar…
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#105AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…
The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.
The application of AI to business problems will be lucrative, but the models are just a tool and the money will come from the domain-specific data (i.e. user and business data), which Microsoft, Google, and even Meta are positioned for. Having a slightly better model but no customer data or domain expertise doesn’t seem like a great recipe.
Then again it’s AI, so there’s more uncertainty than the commodity market. Maybe Anthropic will surprise and I’ll be as wrong about this as I was about OS/2 being the future. But I’m very skeptical.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#106Earlier quoted context omitted.
The main reason why companies don't allow NSFW content is because of puritan payment processors that see that stuff and then go absolute sicko mode and lock people out of the traditional finance system.
It's because NSFW content has higher risks of chargeback and fraud (there's a reason their payment processors charge 20%+). Besides, companies don't want to be on the bad side of outrage; it only takes one mistake of processing a payment for child pornography and your name will be plastered everywhere as a child porn enabler. Do you really think the execs at Visa and Mastercard are puritans and not profiteering capit…
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#107This is a lot of money going into compute. I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#108Earlier quoted context omitted.
The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.
I can already run gpt4xalpaca on my PC, a model that is not-bad-at-all and is completely uncensored (i.e. does things that chatGPT can't do). I think it's true that LLMs are racing to the bottom and will be even more once they can fit as a peripheral to every computer. whoever is investing in this to monopolize has not thought it through
It's not the software or hardware that will "win" the race, it's who delivers the packaged end user capability (or centralizes and grabs most of the value along the chain).
And end user capability is comprised of hardware + software + connectivity + standardized APIs for building software on top + integration into existing systems.
If I were Nvidia, I'd be smiling. They've been here before.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#109Earlier quoted context omitted.
I am willing to bet that a model finetuned on HN will be the bombastic and arrogant enough to pass just fine. The bullshit is already there.
I can confirm, you can see the LLM generated cracked news that someone shared a couple days back. LLM generated articles, comments, and the full suite. It sounded very real even with funny sounding topics lol https://crackernews.github.io/
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#110"Dario Amodei, the former VP of research at OpenAI, launched Anthropic in 2021 as a public benefit corporation, taking with him a number of OpenAI employees, including OpenAI’s former policy lead Jack Clark. Amodei split from OpenAI after a disagreement over the company’s direction, namely the startup’s increasingly commercial focus." So Anthropic is the Google-supported equivalent of OpenAI? Isn't the founder going…
There may have been a disagreement, but now they're focused on profit, as everybody else. From the same article: “Anthropic has been heavily focused on research for the first year and a half of its existence, but we have been convinced of the necessity of commercialization, which we fully committed to in September [2022],” the pitch deck reads. “We’ve developed a strategy for go-to-market and initial product speciali…