Live data from Hacker News

Anthropic’s $5B, 4-year plan to take on OpenAI

techcrunch.com

101–110 of 504 posts

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#101
post #47

Earlier quoted context omitted.

the GPUs these guys would be using are not the same ones you are using to play crysis, we're talking more about this kind of purpose-built thing: https://www.nvidia.com/en-us/data-center/a100/ It's become more of a term for highly parallel processor units in general, one which NVidia encourages because it ties their product offering together

True. I guess those are almost ASICs in a way just with gpu flavour interface

Way less specialized though. I think why most don't go for ASICs at this point, is because once you actually have units being produced, things have changed so much that you'd wish you had something more flexible. That's why general purpose GPUs are used today.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#102
post #21

Earlier quoted context omitted.

I think I’ve used it so much that a sentence in I assumed it was ChatGPT. It has a certain way of speaking.

Why the downvotes? HN is funny...I spent a portion of my life giving HN users a free glimpse of ChatGPT...and I get downvoted + flagged. ChatGPT might actually be more objective, and less passive-aggressive!

AI-generated comments are explicitly forbidden on HN, and should be flagged. See:

https://news.ycombinator.com/item?id=35210503

Everyone has access to ChatGPT, there's no need for you to "give a free glimpse".

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#103
post #6

>“tens of thousands of GPUs.” I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go GPUs presumably come with a lot of unneeded stuff to play crysis etc

There are AI / datacenter focused GPUs (like the A100, H100 etc.). They do not have any graphics rendering circuitry.

> They do not have any graphics rendering circuitry.

What? Not having a display output is not the same as not having graphics rendering circuitry. Here's vulkaninfo from an A100 box: https://gist.github.com/eiz/c1c3e1bd99341e11e8a4acdee7ae4cb4

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#104
post #60
post #37

AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…

Correct. Stability.ai (Stable Diffusion), Apple (Won't be surprising to see them announce on-device LLMs with Apple Silicon support), Meta (LLaMa), etc are already at the bottom and at the finish line with their AI models given for free. O̶p̶e̶n̶AI.com will eventually have to raise their prices which is bad news for businesses not making enough money and still are sitting on their APIs as O̶p̶e̶n̶AI.com themselves ar…

Aside: I love the O̶p̶e̶n̶AI.com thing. I got caught off guard at least twice!

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#105
post #61
post #37

AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…

The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.

That’s an argument, but I don’t buy it. Models are a commodity. You don’t get VC valuations and returns from raising $5B for a grain startup.

The application of AI to business problems will be lucrative, but the models are just a tool and the money will come from the domain-specific data (i.e. user and business data), which Microsoft, Google, and even Meta are positioned for. Having a slightly better model but no customer data or domain expertise doesn’t seem like a great recipe.

Then again it’s AI, so there’s more uncertainty than the commodity market. Maybe Anthropic will surprise and I’ll be as wrong about this as I was about OS/2 being the future. But I’m very skeptical.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#106
post #40

Earlier quoted context omitted.

The main reason why companies don't allow NSFW content is because of puritan payment processors that see that stuff and then go absolute sicko mode and lock people out of the traditional finance system.

It's because NSFW content has higher risks of chargeback and fraud (there's a reason their payment processors charge 20%+). Besides, companies don't want to be on the bad side of outrage; it only takes one mistake of processing a payment for child pornography and your name will be plastered everywhere as a child porn enabler. Do you really think the execs at Visa and Mastercard are puritans and not profiteering capit…

The whole US society seems more puritan while more capitalist at the same time, seen from this side of the pond. It’s a paradox I can’t really explain, any clues?

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#107
post #2

This is a lot of money going into compute. I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.

"Let someone else pay for the open source LLM weights" said everyone.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#108
post #73
post #61

Earlier quoted context omitted.

The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.

I can already run gpt4xalpaca on my PC, a model that is not-bad-at-all and is completely uncensored (i.e. does things that chatGPT can't do). I think it's true that LLMs are racing to the bottom and will be even more once they can fit as a peripheral to every computer. whoever is investing in this to monopolize has not thought it through

This is a repeat of the early GPU era.

It's not the software or hardware that will "win" the race, it's who delivers the packaged end user capability (or centralizes and grabs most of the value along the chain).

And end user capability is comprised of hardware + software + connectivity + standardized APIs for building software on top + integration into existing systems.

If I were Nvidia, I'd be smiling. They've been here before.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#109
post #100

Earlier quoted context omitted.

I am willing to bet that a model finetuned on HN will be the bombastic and arrogant enough to pass just fine. The bullshit is already there.

I can confirm, you can see the LLM generated cracked news that someone shared a couple days back. LLM generated articles, comments, and the full suite. It sounded very real even with funny sounding topics lol https://crackernews.github.io/

It is indeed cracked up LOL

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#110
post #84
post #44

"Dario Amodei, the former VP of research at OpenAI, launched Anthropic in 2021 as a public benefit corporation, taking with him a number of OpenAI employees, including OpenAI’s former policy lead Jack Clark. Amodei split from OpenAI after a disagreement over the company’s direction, namely the startup’s increasingly commercial focus." So Anthropic is the Google-supported equivalent of OpenAI? Isn't the founder going…

There may have been a disagreement, but now they're focused on profit, as everybody else. From the same article: “Anthropic has been heavily focused on research for the first year and a half of its existence, but we have been convinced of the necessity of commercialization, which we fully committed to in September [2022],” the pitch deck reads. “We’ve developed a strategy for go-to-market and initial product speciali…

This is hilarious to me, in that the disgruntled departure just did a 180… how long until the next disgruntled spin-out for higher reasons chases the dollar too…
Post reply on HN