Live data from Hacker News

Anthropic’s $5B, 4-year plan to take on OpenAI

techcrunch.com

41–50 of 504 posts

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#41
post #6

>“tens of thousands of GPUs.” I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go GPUs presumably come with a lot of unneeded stuff to play crysis etc

There are AI / datacenter focused GPUs (like the A100, H100 etc.). They do not have any graphics rendering circuitry.

Does it seems silly to anybody else to even call these GPUs? That's a GPU minus the G.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#42
post #31
post #3

4 years ?!? That’s like a century in AI-dog years. Who knows how the world will be by then.

Is it? I think the recent release of ChatGPT has skewed perceptions. There's no guarantee that there's going to continue to be as ground breaking shifts that have happened recently with llms and diffusion models. To continue with the popular comparison, there were a lot of apps when the iphone first launced the app store before it tapered off. If you looked at just the first year, you'd think we'd have an app for eve…

Also quality of google search after the first few years didn't meaningfully improve as a user. I'd expect the big ramp up we're in to taper off as well. Once you reach the point where you train a model on the corpus of "the whole internet", that's it, all you can do is incrementally train it. Of course there can be whole new architectures but that's harder to put your eggs in for investing.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#43
post #32
post #21

Earlier quoted context omitted.

I think I’ve used it so much that a sentence in I assumed it was ChatGPT. It has a certain way of speaking.

Yes, very recognisable, too polite and servicial for any real human

I am willing to bet that a model finetuned on HN will be the bombastic and arrogant enough to pass just fine. The bullshit is already there.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#44
"Dario Amodei, the former VP of research at OpenAI, launched Anthropic in 2021 as a public benefit corporation, taking with him a number of OpenAI employees, including OpenAI’s former policy lead Jack Clark. Amodei split from OpenAI after a disagreement over the company’s direction, namely the startup’s increasingly commercial focus."

So Anthropic is the Google-supported equivalent of OpenAI? Isn't the founder going to run into the same issues as before (commercialization at OpenAI)? How does Google not use Anthropic as either something commercial or nice marketing material for its AI offerings?

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#45
post #21

Earlier quoted context omitted.

[flagged]

I think I’ve used it so much that a sentence in I assumed it was ChatGPT. It has a certain way of speaking.

Why the downvotes? HN is funny...I spent a portion of my life giving HN users a free glimpse of ChatGPT...and I get downvoted + flagged. ChatGPT might actually be more objective, and less passive-aggressive!

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#46
post #37

AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…

It's a bit early to tell, isn't it?

If we get more unexpected emergent abilities by scaling the model further, things could get very interesting indeed.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#47
post #6

>“tens of thousands of GPUs.” I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go GPUs presumably come with a lot of unneeded stuff to play crysis etc

the GPUs these guys would be using are not the same ones you are using to play crysis, we're talking more about this kind of purpose-built thing: https://www.nvidia.com/en-us/data-center/a100/ It's become more of a term for highly parallel processor units in general, one which NVidia encourages because it ties their product offering together

True. I guess those are almost ASICs in a way just with gpu flavour interface

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#50
post #6

>“tens of thousands of GPUs.” I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go GPUs presumably come with a lot of unneeded stuff to play crysis etc

the GPUs these guys would be using are not the same ones you are using to play crysis, we're talking more about this kind of purpose-built thing: https://www.nvidia.com/en-us/data-center/a100/ It's become more of a term for highly parallel processor units in general, one which NVidia encourages because it ties their product offering together

GPGPU
Post reply on HN