Earlier quoted context omitted.
Spambots learned to autoregister 30 years ago. Do LLMs not do that? Crazy.
User has to email me for access.
Cessation of public development of Kefir C compiler
131–140 of 142 posts
Re: Cessation of public development of Kefir C compiler
#132Earlier quoted context omitted.
> That's simply not correct within the applicable meaning of "derives" as understood in copyright law. Would be rather hard to write a definition that handles it properly back when LLMs didn't exist; not that laws particularly have anything to do with intent/desires behind FOSS anyway - intent is clearly there: you get code, under the condition that if you use it for anything, I get credited; else, you get nothing. >…
> under the condition that if you use it for anything, I get credited; else, you get nothing. But this has never been a condition in the FOSS world, as far as I'm aware. I've only ever seen attribution requirements attach to redistribution of source, not usage of the software. I understand that the crux of the debate here is whether training an LLM is redistribution of the underlying code, but to me, it seems to be f…
AGPL requires that even users using the software even across a network must be provided with a way to get the license (i.e. attribution) and source. Never mind that LLMs consume the source code instead of "using" the software anyway. (and of course things go more downhill for LLMs for licenses more restrictive than AGPL)
Otherwise, I'd say that, for many, the ideal condition for (copyleft) FOSS would be that anything that utilizes source code in any form also provides said source code and license/attribution. Sometimes that can even extend to outputs of software (and e.g. gcc takes time to explicitly state that its compiled code output does not count as being derived from gcc's code).
> whether training an LLM is redistribution of the underlying code
There's a funky side-note of whether LLM training can even be done on material with improperly-followed licensing; if you don't even have the permission to modify the material (as properly following MIT/GPL/etc would give you), it might be illegal to even tokenize it, never mind use it for training.
> That's literally all LLMs do. That's what tokenization is.
It's clearly not that simple, otherwise "split source into 10-char chunks, reverse that list, reverse it back, join this fun list we've gotten" would be enough to circumvent copyright.
> all you'll see on the LLM side is probability matrices representing correlations between decomposed units of knowledge aggregated across the entire dataset as an integrated whole.
Yeah, you need at least that, tokenization is irrelevant. But jury's out on this one - of course a good chunk is some form of "abstract knowledge", but other parts could be just encoding material in some compressed form (and surely gzipping a source code file doesn't circumvent copyright) that at the very least can apply to weights.
> The only intent ever in play is that of the user. LLMs are just software.
So my split-into-words-and-join-back is valid circumvention of copyright, if the user of some software doing that isn't informed that it's just effectively directly copying material. (I'll grant that perhaps, in such, the accidental-infringer might get a smaller penalty and/or get to defer punishment to whoever mismarketed the software to them,...but that wouldn't apply to anyone who knows that LLMs are very much just directly trained on copyrighted material. Don't know about legally derived, but surely mathematically derived)
Never mind that, for some things, learning some specific copyrighted code is the desired thing (humans do do this after all!), at which point at the very least the weights of the model are as copyright-infused as a gzipped source code file is.
If intent determination is on the user, and the user is aware that LLMs are very much technically capable of producing copyrighted works to some extent (which they better be), it would be on the user to ensure that any specific code they end up using is not, which is...a rather non-trivial task (a human that writes code can also reasonably-reason about whether they're infringing on whatever they learned from, but splitting into LLM writing + human checking fundamentally makes that basically infeasible).
Re: Cessation of public development of Kefir C compiler
#133Re: Cessation of public development of Kefir C compiler
#134People taking your work and not giving anything back was ALWAYS the risk you took when writing free software. LLM training doesn't change that much. That the us military no doubt is using gcc to compile embedded software for their icbm:s no doubt irks the gnu people. But you can't have it any other way. "You can only use my software for good things" just is not consistent with "free software".
Yeah, I really can't comprehend these sentiments as anything other than an "I don't like AI" argument. FOSS has always been about just writing code and putting it out into the world where others can do as they please with it. I see a lot of risks involved in people surrendering their own decision-making to LLMs, but that's a question of how they're used, not how they're trained. The idea that using FOSS software to t…
Before AI and in the early days of FOSS, people assumed that the primary recipient of code sharing were other FOSS enthusiasts, in the form of developers and users.
Then there was a wave of permissive licensing, which obviously brought with it corporate interests, however, this was easily foreseeable and many people who favored permissive licensing intentionally did so to appeal to corporate users, so the risk of them quitting due to perceived abuse was slim.
Now that LLMs are a thing, the primary recipient of a lone developer working on his project isn't really another human being. This human connection is now lost. Instead, your project is now laundered through the model and the model vendor can get away with ignoring your terms and conditions and let others write proprietary software.
In this transition period there were developers who thought that there was always going to be a human connection (even if part of a corporation), but then things changed and they realized their world view was wrong. Given the arrival of this new information, they obviously change their behavior in accordance to how the world actually is.
Re: Cessation of public development of Kefir C compiler
#135I have many GPL projects (e.g. https://github.com/rochus-keller/Oberon , https://github.com/rochus-keller/Luon , https://github.com/rochus-keller/Micron ) and spend a significant amount of time in them. GPL has always explicitly permitted commercial use; that's a feature, not a bug, dating back to Stallman's original vision. Any person or company can use my code (or Kefir code) under the terms of the GPL, as I use co…
I feel this is a misrepresentation. GPL rather seems designed to maximize source availability for users.
But mandatory public source availability does make selling software products more difficult ("why would anyone pay if they can just use the source"), which is why most commercial software products still sell and ship binaries when they can.
Re: Cessation of public development of Kefir C compiler
#136I have many GPL projects (e.g. https://github.com/rochus-keller/Oberon , https://github.com/rochus-keller/Luon , https://github.com/rochus-keller/Micron ) and spend a significant amount of time in them. GPL has always explicitly permitted commercial use; that's a feature, not a bug, dating back to Stallman's original vision. Any person or company can use my code (or Kefir code) under the terms of the GPL, as I use co…
> GPL is a license explicitly designed to maximize use I feel this is a misrepresentation. GPL rather seems designed to maximize source availability for users . But mandatory public source availability does make selling software products more difficult ("why would anyone pay if they can just use the source"), which is why most commercial software products still sell and ship binaries when they can.
Right. It depends on what you mean by "use"; GPL maximizes use in the sense that it prevents anyone from taking the code proprietary and thereby restricting future users' access. But it doesn't touch my actual point, which is that GPL explicitly permits commercial use, broad distribution, and also LLM training (none of which are restricted by the license). The source availability requirement is the condition, not a restriction on who can use the code.
> why would anyone pay if they can just use the source
Red Hat, Qt, and countless others have built commercial businesses on GPL code. So apparently there is a business and people willing to pay even if the source code is available. But that was not my point anyway.
Re: Cessation of public development of Kefir C compiler
#137Earlier quoted context omitted.
> GPL is a license explicitly designed to maximize use I feel this is a misrepresentation. GPL rather seems designed to maximize source availability for users . But mandatory public source availability does make selling software products more difficult ("why would anyone pay if they can just use the source"), which is why most commercial software products still sell and ship binaries when they can.
> designed to maximize source availability Right. It depends on what you mean by "use"; GPL maximizes use in the sense that it prevents anyone from taking the code proprietary and thereby restricting future users' access. But it doesn't touch my actual point, which is that GPL explicitly permits commercial use, broad distribution, and also LLM training (none of which are restricted by the license). The source availab…
But I can still understand the Kefir author; if you previously defaulted to GPL (over MIT/BSD) mainly because you wanted to foster an open-source software development culture, then the emergence of LLMs might well be a turning point were publishing your project makes no more sense to you; thanks to LLMs, publishing your open-source project might do more for commercial closed source actors (via better trained LLMs used by the developers they employ) than for open-source developers (or open source culture overall).
Instead of potentially creating a valuable GPL project that pushes other users towards GPL/open source, you might end up making your project a sort of "commodity" easily available to all closed-source developers for a moderate cost in tokens...
Re: Cessation of public development of Kefir C compiler
#138Earlier quoted context omitted.
> designed to maximize source availability Right. It depends on what you mean by "use"; GPL maximizes use in the sense that it prevents anyone from taking the code proprietary and thereby restricting future users' access. But it doesn't touch my actual point, which is that GPL explicitly permits commercial use, broad distribution, and also LLM training (none of which are restricted by the license). The source availab…
I can see your point, and I do agree that people often cry about "but copyright" in LLM contexts when simply not appropriate. But I can still understand the Kefir author; if you previously defaulted to GPL (over MIT/BSD) mainly because you wanted to foster an open-source software development culture, then the emergence of LLMs might well be a turning point were publishing your project makes no more sense to you; than…
Re: Cessation of public development of Kefir C compiler
#139Earlier quoted context omitted.
I can see your point, and I do agree that people often cry about "but copyright" in LLM contexts when simply not appropriate. But I can still understand the Kefir author; if you previously defaulted to GPL (over MIT/BSD) mainly because you wanted to foster an open-source software development culture, then the emergence of LLMs might well be a turning point were publishing your project makes no more sense to you; than…
It's his code and of course he can decide what to do with it. I just think it's a shame when people make hasty, ill-considered decisions based on misunderstandings and false assumptions. Copyright law is (unfortunately) much more complicated than most people realize. There's also an irony worth noting: many of the same developers who expect free access to compilers, libraries, and frameworks built by companies and us…
He explicitly states that the AI training concerns are not about legal GPL violations but about going against his licensing intentions (and those seem very much in line with the "copyleft spirit" from what I can tell).
My take is that the LLM emergence "threatens" the whole copyleft framework in a way similar to cloud services in the past (which led to the AGPL): closed source development can extract a lot of value from copyleft projects without contributing back in any way (to neither upstream nor their own users).
Re: Cessation of public development of Kefir C compiler
#140Earlier quoted context omitted.
It's his code and of course he can decide what to do with it. I just think it's a shame when people make hasty, ill-considered decisions based on misunderstandings and false assumptions. Copyright law is (unfortunately) much more complicated than most people realize. There's also an irony worth noting: many of the same developers who expect free access to compilers, libraries, and frameworks built by companies and us…
Do you think that the author is deciding based on misunderstanding/false assumptions? He explicitly states that the AI training concerns are not about legal GPL violations but about going against his licensing intentions (and those seem very much in line with the "copyleft spirit" from what I can tell). My take is that the LLM emergence "threatens" the whole copyleft framework in a way similar to cloud services in th…
And companies are ultimately owned by people, including ordinary savers whose pension funds depend on them, and they employ people, so they contribute to society.