Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anthropic’s $5B, 4-year plan to take on OpenAI

techcrunch.com

Post reply on HN
Print view View original

241–250 of 504 posts

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#241

Post by pyth0 »

visarga wrote: post #213
wokwokwok wrote: post #165

Earlier quoted context omitted.

It’s astonishing to me that people seem to believe the llama models are “just as good” as the large models these companies are building, and most people are only using the 7B model, because that’s all their hardware can support. …I mean, “not-bad-at-all” depends on your context. For doing mean real work (ie. not porn or spam) these tiny models suck. Yup, even the refined ones with the “good training data”. They’re to…

You know what I believe is also a toy model? chatGPT Turbo, you can tell by the speed of generation. And it works quite well, so small size is not an impediment. I expect there will be an open model on the level of chatGPT by the end of the year because suddenly there are lots of interested parties and investors. Eventually there will be a good enough model for most personal uses, our personal AI OS. When that happen…

> I expect there will be an open model on the level of chatGPT by the end of the year because suddenly there are lots of interested parties and investors.

I really don't think you understand just how absurdly high the cost is to train models of this size (which we still don't know for sure anyways). I struggle to see what entity could afford to do this and release it as no cost. That doesn't even touch on the fact that even with unlimited money, OpenAI is still quite far ahead.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#242

Post by atemerev »

Yizahi wrote: post #226
atemerev wrote: post #138

Earlier quoted context omitted.

Human brain is just an ultra large scale analog spiking neural network with some particular state realizations, not too much difference (the architecture is different, but computation seems to be universal). We even employ some internalized language models for communication purposes (together with object persistence and mental space-time models). So, while we are not yet at the level of full scale human brain emulati…

A small and probably incorrect example. You ask me a direct question - "how much is two plus two?". And I reply to you - "lemons are yellow". Can I do it? Yes I can. Can GPT-* do it? No. There is a whole lot more to human consciousness that pattern matching and synthesis. Or at least it seems so. And if human cognition is really that simple, just with more nodes, then we will soon see GPT-* programs on strike, issuin…

Of course GPT can do it, you just need to raise the inference temperature.

The difference, if it exists, would be more subtle.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#243

Post by gear54rus »

xena wrote: post #136
gear54rus wrote: post #63

Earlier quoted context omitted.

This comment right here can be shown to snobs who still denounce crypto btw

Taking all payment in Ethereum doesn't matter when you have to pay for servers and domain names in fiat.

Lots of work on that front no doubt, and not only wrt domains

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#244

Post by Rufbdbskrufb473 »

xena wrote: post #136
gear54rus wrote: post #63

Earlier quoted context omitted.

This comment right here can be shown to snobs who still denounce crypto btw

Taking all payment in Ethereum doesn't matter when you have to pay for servers and domain names in fiat.

Servers and domains are one of the easiest things to buy with crypto.

I actually just migrated away from Hetzner last week (for unrelated reasons) to two new providers to whom I'm paying crypto (no KYC required) based on this list: https://bitcoin-vps.com/

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#245

Post by RobertDeNiro »

comboy wrote: post #156
alexb_ wrote: post #35

If someone released a chatGPT/characterAI with NSFW content enabled it would eat into a big share of their users (and for characterAI, maybe take all of them). Seriously, look into what people are posting about when it comes to characterAI, and it's 80% "here's how to get around NSFW filters". Unsure why nobody is taking this very very obvious hole in AI tech.

What's with the NSFW need? I'd understand if this is some image generator, but here? Is it some sexting, "romance", or is NSFW about something else altogether?

Fanfiction. It is a huge deal to some people. Many prefer reading stories over watching porn, and we all know how big of a market pornography is.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#246

Post by jahewson »

MagicMoonlight wrote: post #221

It really puts into perspective how much of a meme economy we live in. I just read an article that says global lithium will be worth 15bn a year in 2030 when we're at peak battery demand. This company is planning to spend 1bn just this year in order to run some numbers through someone else's algorithm. People have given them 1bn in cash for that. Clearly it's all bullshit. There's no way they need that much and someb…

You’re comparing single-year market value of a commodity that is dug straight out of an open pit with multi-year capital investment into one of the most advanced technologies the human race has created, currently offered by a single company? I’m not sure where to begin with that.

How much money do you think it takes to finance and build a lithium mine? How much capital investment is there in lithium right now? A lot.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#247

Post by xpe »

MagicMoonlight wrote: post #221

It really puts into perspective how much of a meme economy we live in. I just read an article that says global lithium will be worth 15bn a year in 2030 when we're at peak battery demand. This company is planning to spend 1bn just this year in order to run some numbers through someone else's algorithm. People have given them 1bn in cash for that. Clearly it's all bullshit. There's no way they need that much and someb…

> This company is planning to spend 1bn just this year in order to run some numbers through someone else's algorithm.

“Just”? Reductive mischaracterizations like this are not useful. It looks like a rhetorical technique. What is the actual argument?

It doesn’t matter much “whose” algorithm it is or isn’t, unless IP is important. But in these areas, the ideas and algorithms underlying language models are out there. The training data is available too, for varying costs. Some key differentiators include scale, timeliness, curation, and liability.

> Clearly it's all bullshit. There's no way they need that much and somebody will be siphoning it all off.

There is plenty of investor exaggeration out there. But what percentage of your disposable money would you put on the line to bet against? On what timeframe?

If I had $100 M of disposable wealth, I would definitely not bet against some organizations in the so-called AI arms race becoming big winners.

Again, I’m seeing the pattern of overreaction to perceived overreaction.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#248

Post by programmer_dude »

reubenmorais wrote: post #235
programmer_dude wrote: post #15

Earlier quoted context omitted.

There are AI / datacenter focused GPUs (like the A100, H100 etc.). They do not have any graphics rendering circuitry.

They do have graphics rendering circuitry, but e.g. fewer shading units and more graphics memory, or support for faster interconnects. You can look up the specs and compare. The differences are varied, but IMO not enough to claim they're not GPUs anymore. Even gaming focused GPUs are GPGPUs these days: the RTX 4090 has as many Tensor Core units as the A100. And you can still use e.g. DirectX, OpenGL with a datacenter…

> fewer shading units

This is incorrect. NVIDIA uses a unified graphics and compute engine. A CUDA core is a shading unit. These datacenter GPUs have a shit ton of these (CUDA cores).

Edit: actually the point I want to make is the A100 only retains those hardware units which can be used for compute. Some of these units may have a (dual) use for graphics processing but that is besides the point (since this is true of all CUDA enabled NVIDIA GPUs).

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#250

Post by layer8 »

robertlagrant wrote: post #175
mschild wrote: post #82

Earlier quoted context omitted.

This is not an argument for crypto, it's an argument for better regulations so that processors don't make up their own rules.

> This is not an argument for crypto, it's an argument for better regulations so that processors don't make up their own rules. Better (which I assume is your euphemism for "more") regulation isn't neceesarily the answer, or even particularly the answer. Do you want to force payment processors to do work they don't want to do? Isn't there a word for that?

> Do you want to force payment processors to do work they don't want to do? Isn't there a word for that?

Public utility. That’s what payment processors are at this point, and they should be regulated as such.

Post reply on HN