“We have information that Moonshot distilled Fable for the development of K3”

Post by PaulHoule » Wed, Jul 22, 2026, 5:17 PM UTC

make3 wrote: post #64

madduci wrote: post #55

So what is the issue here? Distilling is still fair, on the same level like Anthropic scraped copyright protected material for their training. So here robbers are blaming robbers? These claims are just pointless, everytime

It's about the claim of whether these companies could develop a similarly powerful model without larger companies building their own first, which is an important point, and it's likely not the case. It's also about the larger companies explaining why they can't be as efficient, of course they can't, they're not just ripping the outputs of another model that someone else invested billions to train.

Post by neals » Wed, Jul 22, 2026, 5:19 PM UTC

Post by make3 » Wed, Jul 22, 2026, 5:20 PM UTC

tamimio wrote: post #38

“If you can’t compete with them, get them banned” - US AI companies

Post by mbmbn » Wed, Jul 22, 2026, 5:21 PM UTC

Post by throwa356262 » Wed, Jul 22, 2026, 5:22 PM UTC

epolanski wrote: post #51

throwa356262 wrote: post #12

Kimi K3 was released July 16, Fable ban was lifted on July 1 but access was still limited. How did Moonshot "distil" a huge model in such short time and still had time to run the benchmarks and do the usual release thingies? I think Anthropic is desperate to stop foreign competition and the administration is happy to help because they too are heavily invested in these companies

This is BS to pressure politicians. Even an openai's guy (head of something made up) called bs on the idea you can train something like k3 by distillation. Anybody I know who works in LLM research says that distillation is either useless or merely useful in post training to show "correct" behavior. And even then you don't get a competing model, if RL on good prompts was that useful, all labs would've long skyrocketed…