Earlier quoted context omitted.
> These complaints of distillation are inflating the problem to make it sound worse than it is Unfortunately, the Reuters piece itself is complicit in this dramatization. The lede paragraph parrots Anthropic's talking point that distillation is an "attack", without using quotes that would alert the reader that this framing is a corporate talking point. Distillation is NOT an attack.
> Distillation is NOT an attack. From the article - > 28.8 million exchanges with Claude through almost 25,000 fraudulent accounts wouldn't that be considered an attack? Not sure what I'm missing here.
Anthropic says Alibaba illicitly extracted Claude AI model capabilities
791–800 of 1001 posts
Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities
#792“Distillation attack” are we joking here. If anything these models should be compelled to be public since they have been trained off public data. What an absurd overreach to call this an attack. It’s clear they are scapegoating national security and China at this point to build an anti-competitive moat. I generally really like Anthropic’s work and models but stuff like this scares me for the future. We are positionin…
Two wrongs don't make a right
Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities
#793“Distillation attack” are we joking here. If anything these models should be compelled to be public since they have been trained off public data. What an absurd overreach to call this an attack. It’s clear they are scapegoating national security and China at this point to build an anti-competitive moat. I generally really like Anthropic’s work and models but stuff like this scares me for the future. We are positionin…
Two wrongs don't make a right
There’s nothing fundamentally wrong with distillation.
Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities
#794Earlier quoted context omitted.
> Distillation is NOT an attack. From the article - > 28.8 million exchanges with Claude through almost 25,000 fraudulent accounts wouldn't that be considered an attack? Not sure what I'm missing here.
Let’s not forget that by the same logic, Anthropic et al are “attacking” copyright holders all around the world by scraping their data unauthorized for training. Pot calling kettle black.
Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities
#795“Distillation attack” are we joking here. If anything these models should be compelled to be public since they have been trained off public data. What an absurd overreach to call this an attack. It’s clear they are scapegoating national security and China at this point to build an anti-competitive moat. I generally really like Anthropic’s work and models but stuff like this scares me for the future. We are positionin…
Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities
#796This kind of systematic distillation by a competitor can allow them to fast-follow you and pick up capabilities. If you've invested in expensive capabilities training, of course you don't want this, so it's in Anthropic's economic interest to hinder it however they can, and that's enough to explain their behaviour here. Anthropic seems to genuinely care about safety though, which for the rest of us means not having m…
Cat's out of the bag. The only way to make them safe is to make sure everyone has access to them. This might be an iffy analogy, but if Dario uses it all the time then so can I: they're kinda like nuclear weapons. If only one country has access to nukes then you're in trouble. If everyone has access to them, then it's mutually assured destruction to use them.
Sure, it could be increasingly bad if open models keep increasing in capability. But it will be much, much worse if only the rich and the powerful have access to this technology, and us -- the have-nots -- will have to contend with whatever scraps we'll be allowed to eat off the table of whichever billionaire is in control. We've already seen a prelude of this with Mythos being restricted and Fable being suddenly yanked. Is this the world you want to live in? Where only Dario and his friends have access?
Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities
#797Earlier quoted context omitted.
The AI companies seem to take the viewpoint that everything on the internet is free, except their stuff. It's okay to hammer some random website with AI crawlers, ignoring robots.txt, and causing bandwidth costs to skyrocket. But if you cost an AI provider money with your data acquisition practices, well, that's just clearly unacceptable.
That's one aspect, which is a bit of a gray zone. But Anthropic trained on pirated books. That is explicitly illegal.
The reward for having a competitive edge is exponentially higher than the risk of a lawsuit. Politicians are still old bureaucrats who don’t understand technology.
Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities
#798Earlier quoted context omitted.
> Distillation is NOT an attack. From the article - > 28.8 million exchanges with Claude through almost 25,000 fraudulent accounts wouldn't that be considered an attack? Not sure what I'm missing here.
An attack against what? The sanctity of "their IP" that is itself the result of a massive copyright violation campaign?
Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities
#799Obviously they didn't ask for permission when scraping all of libgen, reddit, all blog sites for FREE. When China pays for its use and does it I'm supposed to see it as some sort of problem?
Furthermore Chinese models getting better means we Americans might have the chance to use top tier AI without strict KYC built around it. Go Alibaba I say
Re: Anthropic says Alibaba illicitly extracted Claude AI model capabilities
#800Earlier quoted context omitted.
Anthropic raped everyone without asking and stole their labor to build their career-commoditizing tech. Distillation is Robin Hooding it back so that one trillion dollar company doesn't reap all the benefits of their automation of the workforce. Distillation is Prometheus bringing fire from the gods to give to ordinary humans. Something we all own anyway, but that was kept from us. Distillation is freedom. Everyone s…
Eaaaaasy now, the Chinese labs aren't freedom fighters on behalf the common man. They're not non-profits, they're not neutral transnational organizations only dedicated to open source efforts. They're Chinese companies offering open source models now as loss leaders to keep themselves in the game because they know virtually nobody, especially in the corporate world, would contract with them and give them access to th…