41–50 of 742 posts
I can understand that the AI labs might care about other labs distilling their models as it can eat into their competitive advantage, but do consumers care at all? Aren't consumers benefiting from this practice by getting better cheaper models as a result?
cf https://www.reddit.com/r/codex/comments/1uyj6pq/kimi_k3_is_1...
rules for thee but not for me
Plenty of HN readers feel this way and it's a good point, but it has also become an entirely cliché response which pops up like mushrooms anytime "distillation" appears. That means it's against the site guidelines, which ask: " Eschew flamebait. Avoid generic tangents. Omit internet tropes. " - https://news.ycombinator.com/newsguidelines.html I don't mean to pick on you personally! It's just that reflexive responses…
You are a fantastic moderator, but there’s only so much even you can do. If nothing changes about the website, the problem will only get worse. I warned years ago that this would happen, the signs were on the wall immediately.
I can understand that the AI labs might care about other labs distilling their models as it can eat into their competitive advantage, but do consumers care at all? Aren't consumers benefiting from this practice by getting better cheaper models as a result?
> Aren't consumers benefiting from this practice by getting better cheaper models as a result?
Aren't consumers benefiting from cheap chinese batteries, EVs, and drones?
Kimi K3 was released July 16, Fable ban was lifted on July 1 but access was still limited. How did Moonshot "distil" a huge model in such short time and still had time to run the benchmarks and do the usual release thingies? I think Anthropic is desperate to stop foreign competition and the administration is happy to help because they too are heavily invested in these companies
[Fable fires up a ton of subagents. Their reasoning traces are horrific but somehow K3 learned something.]
Even by San Francisco standards, it is amazingly whiny and pathetic for Anthropic to complain about stuff like this. Dario et al violated copyright, stole your GitHub repos, and now they're burning billions of dollars trying to outcompete you. They're real vampires. OTOH Moonshot violated Anthropic's TOS and are, at worst, moochers. But Fable's output is not actually copyrightable.
You wouldn't distill a car.
Is distillation something we have to live with or are there ways to prevent it?