Earlier quoted context omitted.
Unless you’re from mainland China, you should.
Why so? If I'm from Europe or South America, should I hope Anthropic/Openai win?
“We have information that Moonshot distilled Fable for the development of K3”
641–650 of 742 posts
Re: “We have information that Moonshot distilled Fable for the development of K3”
#642Also, I love their choice of words. Like "distillation against", "stealing proprietary technology" - it's all aimed at certain people.
Re: “We have information that Moonshot distilled Fable for the development of K3”
#643Earlier quoted context omitted.
And some people might want to know about [insert your favourite beyond-the-pale-in-the-US topic here, we're on a US forum after all]. I think it would be great if those people could turn to Chinese models, while anyone wanting to know about Uyghur camps can ask the US ones.
There aren’t any. The idea that the censorship environment is the same in the US as it is in China is nonsense used to ‘both sides’ away concerns about the CCP.
Of course that might change in the future but as long as the Chinese companies continue publishing their research and models it only makes it easier for third parties to catch up with them.
Re: “We have information that Moonshot distilled Fable for the development of K3”
#644Earlier quoted context omitted.
Perhaps even more importantly, the current frontier LLM models are self-admittedly the product of enormous quantities of copyright infringement and even less savory inputs, so calling them out for distilling the fruit of that tainted tree reads as highly hypocritical at best.
No - distillation is not data inputs. Raw materials vs. Value add. They are different things, like ore and metal. Distillation is a new thing we need to understand, it's probably closer to IP than not.
That entirely settles it and there isn’t much else to say about.
If Anthropic feels that other countries are violating their EULA well they are free to stop doing business with them.
Re: “We have information that Moonshot distilled Fable for the development of K3”
#645Earlier quoted context omitted.
> it's only now the issues are coming into the commons in a way that industry / society needs the regulatory clarity. you mean like the regulatory clarity surrounding stealing shit to make the LLMs in the first place? > [There is] extensive litigation on the limits of Fair Use to AI development. Currently, we only have 3 first instance decisions out of the 53 cases being tried. It will likely take a decade before we…
It's hilarious to see how all these HN intellectuals, who on any other day are rabidly against most DRM / IP issues all of a sudden become private property absolutists. It's also sadly hypocritical to see all this rhetoric here on this thread decrying SOTAs for using a variety of content for their inputs as somehow sTeaLINg sTufF! ... ... but Chinese SOTA foundries directly using distillation as fair game. I don't th…
If not there is not there is no grey zone whatsoever.
Re: “We have information that Moonshot distilled Fable for the development of K3”
#646Earlier quoted context omitted.
You're being too charitable to Anthropic, and assuming that the way they are abusing the word "distillation" has some real meaning here. It doesn't. Anthropic's models simply do not give you their reasoning output - they give a sanitized "summary" instead, for this exact reason, so that the output is not useful to anyone who might want to use it for training. You can't distill what you are not given - simple as that.…
> Anthropic's models simply do not give you their reasoning output - they give a sanitized "summary" instead, for this exact reason, so that the output is not useful to anyone who might want to use it for training. This is just straight-up factually false. The output of a reasoning model is immensely valuable even without the sanitized summary of the reasoning process - that Anthropic's service does expose to you, ma…
To be fair I find it hard to take this too seriously, shouldn’t it be trivial to just replace “Claude” with any other string in your “distillation” dataset?
Re: “We have information that Moonshot distilled Fable for the development of K3”
#647Earlier quoted context omitted.
It's hilarious to see how all these HN intellectuals, who on any other day are rabidly against most DRM / IP issues all of a sudden become private property absolutists. It's also sadly hypocritical to see all this rhetoric here on this thread decrying SOTAs for using a variety of content for their inputs as somehow sTeaLINg sTufF! ... ... but Chinese SOTA foundries directly using distillation as fair game. I don't th…
> it's hilarious to see how all these HN intellectuals, who on any other day are rabidly against most DRM / IP issues all of a sudden become private property absolutists. for the record, i've always been rabidly pro-copyright since i worked at a performing royalty organization (prs for music) circa 15 years ago, way before i joined hn. i don't use llms for that reason. > It's also sadly hypocritical to see all this r…
There is no second “wrong” here.
Model outputs are not copyrightable. I think that was already established?
Or do you think that Anthropic should own all the code generated by Claude? Surely that would be somewhat problematic?
If Anthropic feels that some of their customers are breaking their EULA (nothing to do with copyright infringement though) they are free to stop doing business with them. Maybe even sue them in civil court for breach of contract (again nothing to do with copyright infringement though)
Re: “We have information that Moonshot distilled Fable for the development of K3”
#648Earlier quoted context omitted.
It's hilarious to see how all these HN intellectuals, who on any other day are rabidly against most DRM / IP issues all of a sudden become private property absolutists. It's also sadly hypocritical to see all this rhetoric here on this thread decrying SOTAs for using a variety of content for their inputs as somehow sTeaLINg sTufF! ... ... but Chinese SOTA foundries directly using distillation as fair game. I don't th…
> It's also sadly hypocritical to see all this rhetoric here on this thread decrying SOTAs for using a variety of content for their inputs as somehow sTeaLINg sTufF! ... > ... but Chinese SOTA foundries directly using distillation as fair game. As someone who says it’s fair game, it’s less that I’m being hypocritical and more that I don’t care that one thief had their shit stolen by a second thief. I also wouldn’t ca…
LLM outputs are not copyrightable (or rather the user is effectively the only one who can own it). It would be problematic if Anthropic owned all the software generated using Claude..
Re: “We have information that Moonshot distilled Fable for the development of K3”
#649Earlier quoted context omitted.
Democratization of information, but Sam Altman gets a $100B net worth and I'm still broke :) I would prefer some sort of democratiziation of the money made from the democratization of information as well
Agreed, i wish that it would have done more than change who gets rich off rent-seeking behavior surrounding the knowledge that others created, instead it just consolidated that from many gatekeepers to a few. I can at least take some measure of pleasure in the fact that it has generally lessened the roadblocks in gathering information. I am still displeased that there are any gatekeepers of humanity's combined knowle…
Businesses like these used to public at reasonable valuations. You could ride with them to trillion dollar valuations and grow your own fortune too. Everyone has a story of buying Apple or Google or Amazon stock and making millions
Now they’re going live at trillion dollar valuations and by the time you get in, all the upside has already gone (see Spacex IPO)
Not only did they steal all human data, they also made sure that the upside was only limited to themselves and their cronies