Live data from Hacker News

Anthropic’s $5B, 4-year plan to take on OpenAI

techcrunch.com

71–80 of 504 posts

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#71
post #41

Earlier quoted context omitted.

There are AI / datacenter focused GPUs (like the A100, H100 etc.). They do not have any graphics rendering circuitry.

Does it seems silly to anybody else to even call these GPUs? That's a GPU minus the G.

Very much absurd. A user above posted GPGPU, which I guess stands for General Purpose Graphics Processing Unit.

In the beginnings of computation these kinds of cards were called accelerators. Dedicated consumer sound cards were a thing, the venerable SoundBlaster. I really would like an AI-Blaster coming out.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#72
post #61
post #37

AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…

The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.

> can probably yield enough profit from spillover hype for investors to make their investments back.

The correct term for this is “pyramid scheme”.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#73
post #61
post #37

AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…

The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.

I can already run gpt4xalpaca on my PC, a model that is not-bad-at-all and is completely uncensored (i.e. does things that chatGPT can't do). I think it's true that LLMs are racing to the bottom and will be even more once they can fit as a peripheral to every computer. whoever is investing in this to monopolize has not thought it through

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#74
post #46
post #37

AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…

It's a bit early to tell, isn't it? If we get more unexpected emergent abilities by scaling the model further, things could get very interesting indeed.

There’s needs to be some difficult barriers to entry beyond having the money to spend on training FLOPS in order for a startup to compete.

I have no idea if there are or there aren’t, but that’s the big question.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#75
post #61

Earlier quoted context omitted.

The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.

> can probably yield enough profit from spillover hype for investors to make their investments back. The correct term for this is “pyramid scheme”.

Nope

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#76
post #46
post #37

AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…

It's a bit early to tell, isn't it? If we get more unexpected emergent abilities by scaling the model further, things could get very interesting indeed.

Would you rather? invest in super intelligent AGI or NOT invest in super intelligent AGI. Especially if one of those emergent abilities is deciding your either with me or against me..lol

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#77

If its THE exponential curve of AGI, every day not invested, will result in years behind in a few months. So these are rather small investments, but still bigger then the "to little to late" of the european union. Its not very visual or intuitive, but in some games, were the resource curve is exponential, small early headstarts become whole armies, were the opponent fields none in very short time. Especially as AGI i…

The real limiting factor of AGI is not going to be AGI -- it's going to be everything else.

Digitization of the last mile (instrumentation, feedback), local networking, local compute, business familiarity with technology, standardized processes, regulatory environment, etc.

AGI will happen when it happens.

But if it happens and an economy doesn't have all the enabling prerequisites, it's not going to have time to develop them, because those are years-long migration and integration efforts.

Which doesn't bode well for AGI + developing economies.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#78
post #8
post #2

This is a lot of money going into compute. I will say this again. EU is sleeping on the opportunity to throw money in an opensource initiative, in a field were money matter and the field is still (kind of) level.

Sure, let's make an EU commercial LLM. Let's start by scraping all the Francophone internet. Then let's remove all the PII data and potentially PII-data. Easy-peasy. Then let's train our network so as not to spew out or make up PII data - easy peasy Then let's make it able to delete PII data that it has inadvertedly collected on request. Simultaneously it should be recording all the conversations for safety reasons.…

You forgot that anyone using it must click a button that says that he will not use it for evil purposes. You also must acknowledge that the AI will not track you. These must be separated disclaimers that need to be validated on every prompt. API usage is thus not allowed.

The AI should also make it 100% clear that whatever gets produced is clearly identifiable as coming form an AI. As a consequence; text cannot be produced because it would be trivial to remove the disclaimer. A currently proposed bill indicates that the AI should only be able to produce images in an obscure format with a randomised watermark that covers at least 65% of the pixels of the image. The bill is scheduled for ratification in 2028 and must be signed by 100% of the state members.

Until then, the grant for the development of this world changing AI is on accelerated path ! Teams can fill a 65 pages document to have a shot at getting a whole $1 million.

Accenture and Capgemini are working on it.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#79
post #40
post #35

If someone released a chatGPT/characterAI with NSFW content enabled it would eat into a big share of their users (and for characterAI, maybe take all of them). Seriously, look into what people are posting about when it comes to characterAI, and it's 80% "here's how to get around NSFW filters". Unsure why nobody is taking this very very obvious hole in AI tech.

The main reason why companies don't allow NSFW content is because of puritan payment processors that see that stuff and then go absolute sicko mode and lock people out of the traditional finance system.

It's because NSFW content has higher risks of chargeback and fraud (there's a reason their payment processors charge 20%+). Besides, companies don't want to be on the bad side of outrage; it only takes one mistake of processing a payment for child pornography and your name will be plastered everywhere as a child porn enabler.

Do you really think the execs at Visa and Mastercard are puritans and not profiteering capitalists that will process payments for NSFW content if they were able to?

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#80
post #52
post #35

If someone released a chatGPT/characterAI with NSFW content enabled it would eat into a big share of their users (and for characterAI, maybe take all of them). Seriously, look into what people are posting about when it comes to characterAI, and it's 80% "here's how to get around NSFW filters". Unsure why nobody is taking this very very obvious hole in AI tech.

It's trivial to fine tune llamma to be NSFW if that's what you want. But there's an entire universe of much more interesting apps that people don't want NSFW stuff in. That's why most foundation models filter it out.

Anything involving llamma is not trivial - if I can't do it on my phone through a website, then you shouldn't expect anyone else to be able to do it. If your instructions involve downloading something, or even so much as touching the command line, it makes it a non-starter for 95% of users.

Get something on the level of character.ai and then you can tell me it's "trivial".

Post reply on HN