Live data from Hacker News

“We have information that Moonshot distilled Fable for the development of K3”

twitter.com

491–500 of 742 posts

Re: “We have information that Moonshot distilled Fable for the development of K3”

#491

Commenters are overlooking the significance of this information and posting emotional reactions based on perceptions of fairness or feelings of schadenfreude. The economic viability of Anthropic and OpenAI rely on their being able to charge more for model access than their R&D and inference costs. If the market price for SOTA model access drops below that level, then these businesses will have to decide whether to co…

s/announcement/claim You don't get to call Moonshot's a "claim" and this political hack's an "announcement." They're the same thing. Treat them the same. Diction designed to favor one of two equal positions is some weak sauce.

You're calling someone a political hack, but imposing neutrality on my statement.

I don't even necessarily disagree with your assessment of this spokesperson. But you must admit how inconsistent you're being.

Re: “We have information that Moonshot distilled Fable for the development of K3”

#492

Earlier quoted context omitted.

Unless you’re from mainland China, you should.

Why? Serious question. I'm from the US, and I think it's hilarious.

One example is that a totalitarian government known for erasing historical record of its crimes will control an arbitrator of truth.

Re: “We have information that Moonshot distilled Fable for the development of K3”

#493

Earlier quoted context omitted.

It matters because the closed-source frontier labs spend lots of money on human data (RLHF / RLAIF with human oversight). Moonshot is accused of circumventing these costs. Frontier labs add research costs into their inference pricing. If the market doesn't permit them to sustain sufficient pricing to have a positive cash flow, then their business prospects become weaker and they risk insolvency. Furthermore, other le…

My parents put in countless hours and tens of thousands of dollars into raising me to the point where I could write an answer on StackOverflow And OpenAI scraped and distilled that answer and gave me nothing

What does your story have to do with Moonshot AI? Do you think they didn't also use the same corpus? Bizarre

Re: “We have information that Moonshot distilled Fable for the development of K3”

#494
post #214

Earlier quoted context omitted.

Oh, so mass theft is okay as long as American companies are doing it

copyright infringement is not theft, even if right holders often claim it is. part of the definition of theft is that the original owner is deprived of it, which does not apply to copyright infringement. You can only argue with damages from the perspective of potential profits, still not theft though. https://en.wikipedia.org/wiki/Theft

This is almost funny to me, because in many jurisdictions, software companies sure invested a lot of effort into painting people copying software as thieves. In Germany, they (the software producer lobby, and later politicians influence by the former) even coined and spread the term "Raubkopie", which you could roughly translate as "robbed copy", i.e., that's one step worse than "theft", as a robbery in Germany legally means " theft accomplished by force or intimidation". So, yeah: like putting a knife to the throat of someone while you copy the software.

So, after literally decades of investing into advertising campaigns, lobbying to politicians to pass harsher and harsher laws against software "thieves and robbers", now that big tech are doing it, suddenly we are supposed to consider it with more nuance?

Ahhh... no thank you sir. I really enjoy them drinking their own kool-aid.

Re: “We have information that Moonshot distilled Fable for the development of K3”

#495

Earlier quoted context omitted.

If they did this in the US they would almost certainly be sued. Meta, for examples, doesn’t want employees to use Claude Code due to distillation risk.

It turns out U.S. law doesn’t have jurisdiction across the entire world, nor does Anthropic and OAI’s rather blatant attempt to buy government influence.

Well its not law. Its more terms of service.

For example, if OpenAI / Anthropic were actually open, other US labs could be building near-frontier open weights models by distilling off OpenAI / Anthropic. But because US companies don't want to be sued, US labs who obey terms of service, will be at a disadvantage to Chinese peers.

Maybe US labs need to just not care and distill from OpenAI / Anthropic anyways?

Re: “We have information that Moonshot distilled Fable for the development of K3”

#496
post #171

Earlier quoted context omitted.

It matters because the closed-source frontier labs spend lots of money on human data (RLHF / RLAIF with human oversight). Moonshot is accused of circumventing these costs. Frontier labs add research costs into their inference pricing. If the market doesn't permit them to sustain sufficient pricing to have a positive cash flow, then their business prospects become weaker and they risk insolvency. Furthermore, other le…

Isn’t that the same argument they are making for replacing human labour? Circumventing costs.

Do you get mad at your computer for replacing clerical workers? What does this nonsense comment have to do with the issue at hand?

Re: “We have information that Moonshot distilled Fable for the development of K3”

#497
post #467

Earlier quoted context omitted.

The models were built using copyrighted works, so why can't models be built using other models?

Because model output is probably far closer to software or a licensed work which possibly has greater protections than it is to copyright. There is far less possibility of fair use, it might be protected by patents, license or reverse engineering laws. In any case the laws are being written now, but I doubt these will have worse protection than software does, which has far better protections than copyright

> I doubt these will have worse protection than software does, which has far better protections than copyright

Software is protected by copyright. Some software may also be protected by patents, but last time I checked, AI generated output of any kind was not patentable.

Re: “We have information that Moonshot distilled Fable for the development of K3”

#498

Who will invest in generating data for the frontier of AI if their output will immediately be used to train a competing model? Forget China vs. US, this applies within-country too. After exhausting all the publicly-accessible data on the internet, the frontier labs started spending hundreds of millions of dollars to generate data across a variety of fields. Just look at Mercor doing $1.2bln/year with 90% coming from…

> So AI will largely hit a wall, frozen at the current level and work will all shift to cheaper inference.

Looks like an ideal outcome to me until (if) we are able to solve the alignment issue.

Re: “We have information that Moonshot distilled Fable for the development of K3”

#499

OpenAI and Anthropic should enter into distillation agreements with other US labs. Turn a threat into a profit center. Other US labs cannot directly distill from OpenAI/Anthropic as it’s a violation of the terms of service. It holds other US labs back. Leading them to build second tier models And in the end OpenAI/Anthropic may be unable to prevent distillation. Why fight it when there’s clear money to make here?

OpenAI/Anthropic are already charging for access to their closed models. They're getting paid. They are also not interested in agreements. They want to keep as big a moat as possible because they love money. And you need two to tango.

Yeah they may not be interested. But pretending you have that moat a dumb strategy that's not working.

Re: “We have information that Moonshot distilled Fable for the development of K3”

#500

[flagged]

Agreed, it's becoming a bit of an echo chamber anytime Chinese models are discussed here. This is really par for the course for China though, in physical manufacturing they've been doing this kind of thing for decades, I'm not surprised the mentality has persisted into the AI race. Looks like rather than jumping ahead, they will remain persistently 6 months behind.
Post reply on HN