Earlier quoted context omitted.
This is why I don't give a shit that this is happening. It's actually kind of funny to me.
Unless you’re from mainland China, you should.
Why?
“We have information that Moonshot distilled Fable for the development of K3”
601–610 of 742 posts
Re: “We have information that Moonshot distilled Fable for the development of K3”
#602if these can be distilled so easily, does the model actually need to be so big and trained with so much electricity?
Re: “We have information that Moonshot distilled Fable for the development of K3”
#603Does this matter? Distillation is not illegal by every definition of the word. There are millions of samples available on huggingface and models explicitely trained on output produced by fable. There has been no action taken against them. Another example is that it appears that the upper limit of what you can do is ultimately dependent on people working on the model, otherwise grok would be a LOT more competitive pre…
Perhaps even more importantly, the current frontier LLM models are self-admittedly the product of enormous quantities of copyright infringement and even less savory inputs, so calling them out for distilling the fruit of that tainted tree reads as highly hypocritical at best.
fair use, both in the original training and in distillation, or rather, anthropic has no copyright at all over the output tokens
Re: “We have information that Moonshot distilled Fable for the development of K3”
#604Earlier quoted context omitted.
> it's only now the issues are coming into the commons in a way that industry / society needs the regulatory clarity. you mean like the regulatory clarity surrounding stealing shit to make the LLMs in the first place? > [There is] extensive litigation on the limits of Fair Use to AI development. Currently, we only have 3 first instance decisions out of the 53 cases being tried. It will likely take a decade before we…
It's hilarious to see how all these HN intellectuals, who on any other day are rabidly against most DRM / IP issues all of a sudden become private property absolutists. It's also sadly hypocritical to see all this rhetoric here on this thread decrying SOTAs for using a variety of content for their inputs as somehow sTeaLINg sTufF! ... ... but Chinese SOTA foundries directly using distillation as fair game. I don't th…
idk. i think its fair use when anthropic trains off of copyrighted works, and theres no property rights at all related to the model outputs
there's no creative work between the weights and the tokens being made.
whats the big deal if chinese companies sell an exact replica of the model? its a summary of a variety of works of text and images
Re: “We have information that Moonshot distilled Fable for the development of K3”
#605[flagged]
Re: “We have information that Moonshot distilled Fable for the development of K3”
#606Nice! I hope to see continued liberation of these locked up SOTA models. Cloud is a virtual prison, since other people's policies on what they think a user should and should not do cannot be [easily] bypassed, if enforced remotely on a cloud. All digital natives should be skeptical of cloud-hosted services or software. Think like an intelligence agency or sovereign: how are you going to get screwed by the cloud? Your data is fully accessible by the provider, and they can surveil your activities. You probably can't pirate it, so you are a slave in their rentier model. You could be prevented from doing something you want to do, because the provider disagrees philosophically or economically with your desire. You could be stripped of your information/data by a ban due to their policy enforcement system triggering.
One should live by the maxim: you don't have the thing if you don't possess the file or its processing. That goes for streaming, software, machine learning models, file storage, etc. But I digress; I am happy to see these paternalistic rentiers getting bit by these liberation/copying efforts, and human interests are served every time the digital and infrastructure locks are broken. I will always stand by the distillers!
Re: “We have information that Moonshot distilled Fable for the development of K3”
#607Earlier quoted context omitted.
Do Americans even believe that US policy is likely to steer development in a way that’s safe and beneficial for humanity? The rest of the world certainly doesn’t. The US currently seems to primarily use their superpower status to be the world’s number one shit disturber and geopolitical antagonist. I don’t think China’s necessarily any better, but I’d rather have the most powerful models be open rather than under the…
China uses its power to make favorable deals and get people hooked on what it's slinging so it has captive customers. The US uses its power to bully and break rules that apply to everyone else for its own benefit. Kind of a big difference.
Not really. Go ask someone in Tibet/HongKong/Taiwan/Japan/India if China isn't breaking rules and bullying them. If China had US's powers/economy, it would be a much bigger bully.
https://en.wikipedia.org/wiki/Wolf_warrior_diplomacy
https://en.wikipedia.org/wiki/Chinese_police_overseas_servic...
Re: “We have information that Moonshot distilled Fable for the development of K3”
#608Doesn’t feel nice, does it, Anthropic?
Re: “We have information that Moonshot distilled Fable for the development of K3”
#609Earlier quoted context omitted.
Perhaps even more importantly, the current frontier LLM models are self-admittedly the product of enormous quantities of copyright infringement and even less savory inputs, so calling them out for distilling the fruit of that tainted tree reads as highly hypocritical at best.
No, they settled that yesterday, so all is forgotten. Press releases were queued for today so just in the nick of time.
So Moonshot is next for a lawsuit or do lawyers only care about Anthropic?
Re: “We have information that Moonshot distilled Fable for the development of K3”
#610Nice! I hope to see continued liberation of these locked up SOTA models. Cloud is a virtual prison, since other people's policies on what they think a user should and should not do cannot be [easily] bypassed, if enforced remotely on a cloud. All digital natives should be skeptical of cloud-hosted services or software. Think like an intelligence agency or sovereign: how are you going to get screwed by the cloud? Your…
Do you think China is doing this for the reasons you mentioned: liberation..efforts, human interests and freedom of policy?