China has done this with absolutely everything, starting with “customs inspections” of ships engineering sections by “inspectors” drawing diagrams of what they see. Bit late to be worrying about it now. This only matters now because China is now near parity in tech and vastly superior in production ability. Meanwhile we run out of bullets in a five month war with Iran.
“We have information that Moonshot distilled Fable for the development of K3”
131–140 of 742 posts
Re: “We have information that Moonshot distilled Fable for the development of K3”
#132Earlier quoted context omitted.
Why not? Ford distilled Chinese EVs. https://www.businessinsider.com/ford-ceo-taking-apart-tesla-...
and the Chinese distilled western cars for years and years before that and weren't shy about it.
Of course - buying a competitors product and tearing it down to analyze it is business as usual.
The stupidest part of this is that Anthropic don't even provide the real reasoning traces in their model output. It would be like Ford buying a Chinese EV to tear down, then realizing that the seller had removed the battery and charging system before shipping it to them.
Does anyone believe for a second that Anthropic isn't sending requests to all the Chinese models and analyzing the crap out of them to assess how capable they are, what their reasoning looks like etc?! I guess they'd call that "using" the model, since that sounds nicer.
Re: “We have information that Moonshot distilled Fable for the development of K3”
#133I can understand that the AI labs might care about other labs distilling their models as it can eat into their competitive advantage, but do consumers care at all? Aren't consumers benefiting from this practice by getting better cheaper models as a result?
[deleted]
Re: “We have information that Moonshot distilled Fable for the development of K3”
#134How does one distill? Just send a million request asking for information? Start with the letter A?
Probably the agent workflow traces, including thinking sections, are of main interest. Used in late training for decision making and problem solving strategies.
Re: “We have information that Moonshot distilled Fable for the development of K3”
#135So what is the issue here? Distilling is still fair, on the same level like Anthropic scraped copyright protected material for their training. So here robbers are blaming robbers? These claims are just pointless, everytime
"You are trying to kidnap what I have rightfully stolen!"
the whole AI is just internet distilled !!
Re: “We have information that Moonshot distilled Fable for the development of K3”
#136"Well, Steve, I think there's more than one way of looking at it. I think it's more like we both had this rich neighbor named Xerox and I broke into his house to steal the TV set and found out that you had already stolen it."
Re: “We have information that Moonshot distilled Fable for the development of K3”
#137So what is the issue here? Distilling is still fair, on the same level like Anthropic scraped copyright protected material for their training. So here robbers are blaming robbers? These claims are just pointless, everytime
> on the same level like Anthropic scraped copyright protected material for their training. I see no problem with distillation, on the other hand the complete dismissal of copyright by AI labs is pretty bad, I don’t think we should put them at the same level
> on the other hand the complete dismissal of copyright by AI labs
Courts keep ruling over and over that an LLM trained on copyrighted works qualifies as a transformative work and is therefore fair use. They don't have to dismiss copyright law, this has always been allowed.
The only thing they get in trouble for is pirating the works to get their hands on them.
Re: “We have information that Moonshot distilled Fable for the development of K3”
#138How was K3 trained on data distilled from Fable when Fable was only publicly available in the last two weeks before K3 was released? The timing just doesn't work.
Re: “We have information that Moonshot distilled Fable for the development of K3”
#139Does this matter? Distillation is not illegal by every definition of the word. There are millions of samples available on huggingface and models explicitely trained on output produced by fable. There has been no action taken against them. Another example is that it appears that the upper limit of what you can do is ultimately dependent on people working on the model, otherwise grok would be a LOT more competitive pre…
It doesn't matter. It is most likely a pretext for upcoming actions mostly likely executed via yet another retarded executive order. The guy that posted this looks like he's drowned himself in the MAGA Koolaid.
Re: “We have information that Moonshot distilled Fable for the development of K3”
#140But wasn’t fable distilled from knowledge taken from others? I get why Anthropic is angry here, but it would appear they’re not really in a position to complain about this.