I'm so happy now LLMs are democratising access to programming, especially open models like what Meta with Llama and Mistral is doing with Codestral are doing. The abundance of programming is going to allow almost everyone to become a great programmer. This is so exciting to see and each day programming is becoming a solved problem so we can focus on other things.
I'm skeptical. I've run into people who used LLMs to code, then can't debug it without someone else's help. It may get you 80% there though.
Codestral: Mistral's Code Model
161–170 of 225 posts
Re: Codestral: Mistral's Code Model
#162Re: Codestral: Mistral's Code Model
#163Earlier quoted context omitted.
Taken to the extreme, a sufficiently broken down prompt is simply the code itself. The whole point is to prompt less?
> Taken to the extreme, a sufficiently broken down prompt is simply the code itself it is not. But the artifacts generated through the steps will be code. The last prompt will have most of the code supplied to it as the context.
Re: Codestral: Mistral's Code Model
#164Earlier quoted context omitted.
I did not give consent to train on my software and the license does not allow commercial use of it. They have taken my code and now are dictating how I can use their derived work. Personally I think these tools are useful, but if the data comes from the commons the model should also belong to the commons. This is just another attempt to gain private benefit from public work. There are legal issues to be resolved, and…
Mistral is as open as they get, most others are far worse. Here you can use the model without issues, as others are saying it’s doubtful they would sue you if you were to use code generated by the model in a commercial app
[1] https://huggingface.co/replit/replit-code-v1-3b
Re: Codestral: Mistral's Code Model
#165Earlier quoted context omitted.
> Taken to the extreme, a sufficiently broken down prompt is simply the code itself it is not. But the artifacts generated through the steps will be code. The last prompt will have most of the code supplied to it as the context.
No he is right, he is saying taken to the extreme. The point is the more and more specific you have to prompt, the more you are actually contributing to the result yourself and the less the model is
Re: Codestral: Mistral's Code Model
#166The license for this [1] prohibits use of the model and its outputs for any commercial activity, or even any "live" (whatever that means) conditions, commercial or not. There seems to be an exclusion for using the code outputs as part of "development". But wait! It also prohibits "any internal usage by employees in the context of the company's business activities". However you interpret these clauses, this puts their…
From the website: > licensed under the new Mistral AI Non-Production License, which means that you can use it for research and testing purposes. ... Which basically means "we give you this model. Go find its weaknesses and report on r/locallama. Then we'll use that to improve our commercial model which we won't open-source." I'm sick of abusing the word "open-source" in this field.
Re: Codestral: Mistral's Code Model
#167Earlier quoted context omitted.
Copyright on the software that produces something isn't the same as copyright on the output. The library's copyright is intact, as normal, and they can control who uses it and how just like any other software. The output of AI systems is not copyrightable, but the systems themselves are, and associated EULAs are valid.
Is that so certain? To be able to make claims for what you can use the output, can you do it without making any claims for about control and ownership of the output? Of course, they can revoke your right to use the software, but if it goes to court, that would be interesting case.
I don’t know why there isn’t more discussion on this point and people just assume there’s an underlying copyright basis to the licensing of weights. As far as I know that isn’t settled at all.
Re: Codestral: Mistral's Code Model
#168Earlier quoted context omitted.
>Zuck has mentioned recently That's a really surprising thing to hear, where did you see that? The only quote I've seen is this one: >“One hypothesis was that coding isn’t that important because it’s not like a lot of people are going to ask coding questions in WhatsApp,” he says. “It turns out that coding is actually really important structurally for having the LLMs be able to understand the rigor and hierarchical s…
He mentioned it on the Dwarkesh podcast: https://www.youtube.com/watch?v=bc6uFV9CJGg
Re: Codestral: Mistral's Code Model
#169Earlier quoted context omitted.
I did not give consent to train on my software and the license does not allow commercial use of it. They have taken my code and now are dictating how I can use their derived work. Personally I think these tools are useful, but if the data comes from the commons the model should also belong to the commons. This is just another attempt to gain private benefit from public work. There are legal issues to be resolved, and…
Mistral is as open as they get, most others are far worse. Here you can use the model without issues, as others are saying it’s doubtful they would sue you if you were to use code generated by the model in a commercial app
Re: Codestral: Mistral's Code Model
#170Earlier quoted context omitted.
> So basically I, as an open source author, had my code eaten up by Mistral without my consent Not necessarily. You consented to people reading your code and learning from it when you posted it on Github. Whether or not there's an issue with AI doing the same remains to be settled. It certainly isn't clear cut that separate consent would be required.
MIT/BSD code is fair game, but isn't the whole point of GPL/AGPL "you can read and share and use this, but you can't take it and roll it into your closed commercial product for profit"? It seems like what Mistral and co are doing is a fundamental violation of the one thing GPL is striving to enforce.