Earlier quoted context omitted.
I suppose the alternative it to go completely the other way and call it "sky net".
Yes Dave, that would be a great name. :)
Anthropic’s $5B, 4-year plan to take on OpenAI
201–210 of 504 posts
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#202Earlier quoted context omitted.
Imagine you're a tech company that pays software engineers $200K/year. There is a free open-source coding model that can double their productivity, but a commercial solution yields a 2.1x productivity improvement for $5000 annually per developer. Which do you pick?
Not sure if parent had a certain answer in mind, but my answer is OSS because (1) I can try it out whenever I want, and (2) I don't have the vexing experience of convincing the employer to purchase it.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#203Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#204Earlier quoted context omitted.
I know you said no details, but can you at least share a little bit more about Claude LLM's code generation?
There is a language with massive usage in the enterprise but with very few (if any) high quality code examples on the public internet. When given a broad task, GPT4 doesn’t just write incorrect code, it tries to do entire categories of things the language literally cannot do because of the ecosystem it runs inside. Claude does a much better job writing usable code, but more importantly it does NOT tell you to do thin…
The edits required were minimal --- maybe one screw-up for every 100 lines of code --- and I learned a lot of better ways to do things.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#205Earlier quoted context omitted.
Not sure if parent had a certain answer in mind, but my answer is OSS because (1) I can try it out whenever I want, and (2) I don't have the vexing experience of convincing the employer to purchase it.
That’s the endless «build vs buy” argument. And countless businesses are buying.
In the GP's scenario, I wouldn't be building either piece of software.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#206If someone released a chatGPT/characterAI with NSFW content enabled it would eat into a big share of their users (and for characterAI, maybe take all of them). Seriously, look into what people are posting about when it comes to characterAI, and it's 80% "here's how to get around NSFW filters". Unsure why nobody is taking this very very obvious hole in AI tech.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#207AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…
> convince gullible investors that there's money to be made with foundational models. There's not. This is a ridiculously myopic statement. Foundation models are an extremely powerful technological advancement and they will shake the global economy as very few things did in human history. It's hard to imagine how this is not obvious to everyone right now, specially here in this forum.
The question is whether whomever builds them can make a profit doing so, or will they just end up being the suckers that everyone who actually makes money piggybacks off. It's really not clear at the moment.
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#208Earlier quoted context omitted.
There are AI / datacenter focused GPUs (like the A100, H100 etc.). They do not have any graphics rendering circuitry.
> They do not have any graphics rendering circuitry. What? Not having a display output is not the same as not having graphics rendering circuitry. Here's vulkaninfo from an A100 box: https://gist.github.com/eiz/c1c3e1bd99341e11e8a4acdee7ae4cb4
Edit: I do not see a rasterizer anywhere in the block diagram (pg 14): https://resources.nvidia.com/en-us-genomics-ep/ampere-archit...
Look at Turing's block diagram here (pg 20): https://images.nvidia.com/aem-dam/en-zz/Solutions/design-vis...
You can clearly see that the "Raster Engine" and "PolyMorph Engine" are missing from GA100 (but can be seen in TU100 for example).
To learn about these Graphics Engines see: https://www.anandtech.com/show/2918/2
Re: Anthropic’s $5B, 4-year plan to take on OpenAI
#209Certainly, well at least for now, the compute and storage requirements are enough that someone will eventually run out of funny money and need to charge _someone_ a significant amount of money for utilizing it?