Earlier quoted context omitted.
I know you said no details, but can you at least share a little bit more about Claude LLM's code generation?
There is a language with massive usage in the enterprise but with very few (if any) high quality code examples on the public internet. When given a broad task, GPT4 doesn’t just write incorrect code, it tries to do entire categories of things the language literally cannot do because of the ecosystem it runs inside. Claude does a much better job writing usable code, but more importantly it does NOT tell you to do thin…
Anthropic’s $5B, 4-year plan to take on OpenAI
111–120 of 504 posts
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#112AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…
The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#113Earlier quoted context omitted.
It's because NSFW content has higher risks of chargeback and fraud (there's a reason their payment processors charge 20%+). Besides, companies don't want to be on the bad side of outrage; it only takes one mistake of processing a payment for child pornography and your name will be plastered everywhere as a child porn enabler. Do you really think the execs at Visa and Mastercard are puritans and not profiteering capit…
The whole US society seems more puritan while more capitalist at the same time, seen from this side of the pond. It’s a paradox I can’t really explain, any clues?
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#114Earlier quoted context omitted.
It's a bit early to tell, isn't it? If we get more unexpected emergent abilities by scaling the model further, things could get very interesting indeed.
There’s needs to be some difficult barriers to entry beyond having the money to spend on training FLOPS in order for a startup to compete. I have no idea if there are or there aren’t, but that’s the big question.
FWIW, I do find that Claude (Anthropic's GPT) is often better than GPT4 -- and very fast. Entrants can compete on price, safety, quality, etc.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#115Earlier quoted context omitted.
The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.
That’s an argument, but I don’t buy it. Models are a commodity. You don’t get VC valuations and returns from raising $5B for a grain startup. The application of AI to business problems will be lucrative, but the models are just a tool and the money will come from the domain-specific data (i.e. user and business data), which Microsoft, Google, and even Meta are positioned for. Having a slightly better model but no cus…
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#116A Mathematical Framework for Transformer Circuits: https://www.anthropic.com/index/a-mathematical-framework-for...
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#117If its THE exponential curve of AGI, every day not invested, will result in years behind in a few months. So these are rather small investments, but still bigger then the "to little to late" of the european union. Its not very visual or intuitive, but in some games, were the resource curve is exponential, small early headstarts become whole armies, were the opponent fields none in very short time. Especially as AGI i…
The real limiting factor of AGI is not going to be AGI -- it's going to be everything else. Digitization of the last mile (instrumentation, feedback), local networking, local compute, business familiarity with technology, standardized processes, regulatory environment, etc. AGI will happen when it happens. But if it happens and an economy doesn't have all the enabling prerequisites, it's not going to have time to dev…
I wouldn't be so sure about that because of the Region Beta paradox. Developed countries have processes that work, making all of them digital and connected is often a bigger uphill battle than starting from zero and doing it right the first time.
See also communication infrastructure in developing economies. It's often much easier to get good internet connection (in reasonably populated areas) if there is no 100-year-old copper infrastructure around that is "good enough" for many.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#118Earlier quoted context omitted.
Sure, let's make an EU commercial LLM. Let's start by scraping all the Francophone internet. Then let's remove all the PII data and potentially PII-data. Easy-peasy. Then let's train our network so as not to spew out or make up PII data - easy peasy Then let's make it able to delete PII data that it has inadvertedly collected on request. Simultaneously it should be recording all the conversations for safety reasons.…
The secret is not scraping PII in the first place (which is not really difficult, though it requires some planning)
Can you elaborate? Because I think it’s nearly insurmountable.
Is the sentence “Meagan Smith graduated magma cum laude from Northwestern’s business program in 2004” PII? How about if another part of the corpus says “M. Smith had a promising career in business after graduating with honors from a prestigious school, but an unplanned pregnancy caused her to quit her job in 2006”?
Does it matter if it’s from fiction? What if the fiction it comes from uses real people? Or if there might be both real and fictional Meagan Smiths?
And how so you process that kind of thing at the scale of billions of documents?
This is a very hard problem, especially at scale.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#119Earlier quoted context omitted.
It's trivial to fine tune llamma to be NSFW if that's what you want. But there's an entire universe of much more interesting apps that people don't want NSFW stuff in. That's why most foundation models filter it out.
the point is though the market potential is huge. and it would be a way to grow fast with cash flow. as a side effect you would probably develop the best NSFW filter in the world also.
Until the US payment processors cut you off, then you go bankrupt.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#120AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…
The counter argument is that it's a growing market where any early entrants will be lifted with the tide and can probably yield enough profit from spillover hype for investors to make their investments back.