Anthropic’s $5B, 4-year plan to take on OpenAI • Hacker News Board

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#171

Post by robertlagrant » Tue, Apr 11, 2023, 1:54 PM UTC

lelanthran wrote: post #134

dpflan wrote: post #110

Earlier quoted context omitted.

This is hilarious to me, in that the disgruntled departure just did a 180… how long until the next disgruntled spin-out for higher reasons chases the dollar too…

> This is hilarious to me, in that the disgruntled departure just did a 180… how long until the next disgruntled spin-out for higher reasons chases the dollar too… The cynic in me wants to ask "What makes you think his departure was because of an anti-commercialisation position?" My take (probably just as wrong as everybody's else take) is that he saw the huge commercialisation potential and realised that he could ma…

That does seem more likely. Let's hope his VP of research does the same thing to him (-:

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#172

Post by robertlagrant » Tue, Apr 11, 2023, 1:55 PM UTC

nickpp wrote: post #106

boeingUH60 wrote: post #79

Earlier quoted context omitted.

It's because NSFW content has higher risks of chargeback and fraud (there's a reason their payment processors charge 20%+). Besides, companies don't want to be on the bad side of outrage; it only takes one mistake of processing a payment for child pornography and your name will be plastered everywhere as a child porn enabler. Do you really think the execs at Visa and Mastercard are puritans and not profiteering capit…

The whole US society seems more puritan while more capitalist at the same time, seen from this side of the pond. It’s a paradox I can’t really explain, any clues?

You're conflating capitalism and greed. Plenty of greedy people in non-capitalist systems.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#173

Post by MattRix » Tue, Apr 11, 2023, 1:55 PM UTC

audunw wrote: post #83

omneity wrote: post #3

4 years ?!? That’s like a century in AI-dog years. Who knows how the world will be by then.

AI seems to progress in bursts, and I think we're in the middle of one, but it may be naive to think the progress will continue at the same pace for another 4 years. When Big Blue beat Kasparov in Chess in 1997, I wonder if anyone would've guessed that it'd take almost 20 years for a computer to beat a master in Go. IBM Watson was launched in 2010 and had many of the same promises as GPT. It supposedly fell flat in m…

Even if the technology froze at GPT-4 and never advanced, it would still be enough to change the world in all kinds of ways. The fact that the tech is still advancing as well is huge. Also now you’re seeing tons of solo devs, startups, and large corporations all coming up with new ways to use AI. This “burst” is not like the others you mentioned.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#174

Post by cubefox » Tue, Apr 11, 2023, 1:55 PM UTC

didgeoridoo wrote: post #5

Anthropic’s Claude LLM is pretty interesting. In many ways it feels much more limited than GPT4. However, it is suspiciously good at a few edge-case code generation tasks (can’t go into details) that makes me wonder where it got its training data from. It also seems to be much less prone to hallucinating APIs and modules, preferring instead to switch back to natural language and describe the task without pretending i…

Anthropic actually uses a more cutting edge fine-tuning than OpenAI, a technique that doesn't rely on RLHF. Maybe this gives it an advantage in some areas even if their base model is only on the level of GPT-3.5 (used in free ChatGPT).

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#175

Post by robertlagrant » Tue, Apr 11, 2023, 1:56 PM UTC

mschild wrote: post #82

gear54rus wrote: post #63

Earlier quoted context omitted.

This comment right here can be shown to snobs who still denounce crypto btw

This is not an argument for crypto, it's an argument for better regulations so that processors don't make up their own rules.

> This is not an argument for crypto, it's an argument for better regulations so that processors don't make up their own rules.

Better (which I assume is your euphemism for "more") regulation isn't neceesarily the answer, or even particularly the answer. Do you want to force payment processors to do work they don't want to do? Isn't there a word for that?

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#176

Post by thomastjeffery » Tue, Apr 11, 2023, 1:56 PM UTC

Havoc wrote: post #6

>“tens of thousands of GPUs.” I find the focus on GPUs a little odd. I would have thought that at 5 billion / 4 year scale ASIC route would be the way to go GPUs presumably come with a lot of unneeded stuff to play crysis etc

GPGPU is not new. If it's good for your use case, then it's what you need.

It's not like they are getting RTX cards with useless raytracing shit.

Unneeded stuff would be the cost of making and ASIC for a workload that GPUs already handle well. GPU manufacturing already exists.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#177

Post by dauertewigkeit » Tue, Apr 11, 2023, 1:57 PM UTC

rsp1984 wrote: post #37

AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…

Who says that the AI model is the business?

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#178

Post by edgyquant » Tue, Apr 11, 2023, 1:57 PM UTC

nickpp wrote: post #106

boeingUH60 wrote: post #79

Earlier quoted context omitted.

It's because NSFW content has higher risks of chargeback and fraud (there's a reason their payment processors charge 20%+). Besides, companies don't want to be on the bad side of outrage; it only takes one mistake of processing a payment for child pornography and your name will be plastered everywhere as a child porn enabler. Do you really think the execs at Visa and Mastercard are puritans and not profiteering capit…

The whole US society seems more puritan while more capitalist at the same time, seen from this side of the pond. It’s a paradox I can’t really explain, any clues?

US society isn’t some anti-sex dystopia. Its average compared to the rest of the world, It’s just Europe that is super pro-nudity etc and projects. Like everything else they think they are objectively right in their beliefs and systems.

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#179

Post by GalahiSimtam » Tue, Apr 11, 2023, 1:57 PM UTC

comboy wrote: post #156

alexb_ wrote: post #35

If someone released a chatGPT/characterAI with NSFW content enabled it would eat into a big share of their users (and for characterAI, maybe take all of them). Seriously, look into what people are posting about when it comes to characterAI, and it's 80% "here's how to get around NSFW filters". Unsure why nobody is taking this very very obvious hole in AI tech.

What's with the NSFW need? I'd understand if this is some image generator, but here? Is it some sexting, "romance", or is NSFW about something else altogether?

Per description of a certain item in Fallout 2, "if you need to ask, you don't want to know".

UPDATE:

while fanfiction might be behind this vocal minority, there could be other uses of LLMs, for example translation

I don't go as far as "gender-swapping", because GPT4 swaps a man on a beach wearing only beach shorts for a woman wearing only beach shorts

Re: Anthropic’s $5B, 4-year plan to take on OpenAI

#180

Post by dmix » Tue, Apr 11, 2023, 1:58 PM UTC

pera wrote: post #144

rsp1984 wrote: post #37

AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…

> convince gullible investors that there's money to be made with foundational models. There's not. This is a ridiculously myopic statement. Foundation models are an extremely powerful technological advancement and they will shake the global economy as very few things did in human history. It's hard to imagine how this is not obvious to everyone right now, specially here in this forum.

Plus you're also investing in getting the talent together in the same building. Even if the foundational models aren't the money maker there's still a ton of opportunity having the best experts at building those models working together and figuring out which branches that LLMs spawns can turn into real markets.

It's a high risk investment at this stage but the money is being thrown at the people as much as the current business plan.