Live data from Hacker News

Codestral: Mistral's Code Model

mistral.ai

101–110 of 225 posts

Re: Codestral: Mistral's Code Model

#101

Earlier quoted context omitted.

> I'm sick of abusing the word "open-source" in this field. They don’t call this open source anywhere, do they? As far as I can see, they only say it’s open weights and that it’s available under their Mistral AI Non-Production License for research and testing. That doesn’t scream “open source” to me.

They do say "open-weight", which is I think still very misleading in this context. Open-weight sounds like it should be the same as open-source, just for weights instead of the full source (for example, training data and the code used to generate the weights may not be released). This isn't really "open" in any meaningful sense.

The fact that I can downloaded it and run it myself is a pretty meaningful amount of openness to me. I can easily ignore their bogus claims about what I'm allowed to do with it due to their distribution model. I can't necessarily do the same with a propriety service, as they can cut me off if the way I use the output makes them sad :(

Re: Codestral: Mistral's Code Model

#102

Earlier quoted context omitted.

From the website: > licensed under the new Mistral AI Non-Production License, which means that you can use it for research and testing purposes. ... Which basically means "we give you this model. Go find its weaknesses and report on r/locallama. Then we'll use that to improve our commercial model which we won't open-source." I'm sick of abusing the word "open-source" in this field.

> I'm sick of abusing the word "open-source" in this field. They don’t call this open source anywhere, do they? As far as I can see, they only say it’s open weights and that it’s available under their Mistral AI Non-Production License for research and testing. That doesn’t scream “open source” to me.

No but they do say "empowering developers" and "democratising coding" as the subtitle, I guess only those who pay

Re: Codestral: Mistral's Code Model

#104
post #37
post #28

Is there a way to use this within VSCode like copilot , meaning having the "shadow code" appear while you code instead of having to tho back-and-forth between the editor and a chat-like interface ? For me, a significant component of the quality of these tools resides on the "client" side; being able to engineer a prompt that will yield to accurate code being generated by the model. The prompt needs to find and embed…

Not using Codestral (yet) but check out Continue.dev[1] with Ollama[2] running llama3:latest and starcoder2:3b. It gives you a locally running chat and edit via llama3 and autocomplete via starcoder2. It's not perfect but it's getting better and better. [1] https://www.continue.dev/ [2] https://ollama.com/

Codestral was just published here as well: https://ollama.com/library/codestral

Re: Codestral: Mistral's Code Model

#105
post #91

Are there any IDE plugins that index your entire code base in order to provide contextual responses AND let you pick between the latest models? If not, consider it a product idea ;)

There are plugins for various IDEs that operate like copilot but let you select model you want to use, just supply your key. CodeGPT for JetBrains/Android Studio is pretty good. I think you can even use a model running locally.

Re: Codestral: Mistral's Code Model

#106
post #60

Earlier quoted context omitted.

Break your prompt up into smaller pieces and it can.

Taken to the extreme, a sufficiently broken down prompt is simply the code itself. The whole point is to prompt less?

More practically, the whole point is to prompt enough to generate valid code.

Re: Codestral: Mistral's Code Model

#107
post #79

I'm so happy now LLMs are democratising access to programming, especially open models like what Meta with Llama and Mistral is doing with Codestral are doing. The abundance of programming is going to allow almost everyone to become a great programmer. This is so exciting to see and each day programming is becoming a solved problem so we can focus on other things.

I would argue the opposite is true. My experience with coding with LLMs is that the only thing it's really good at is generating boilerplate that it has more-or-less seen before (essentially a library, even if is somewhat adapted), however it is incapable of the creative thinking that developers regularly need to engage in when architecting a solution for their use case.

My experience is the opposite. When I started using Copilot I thought it would only be good at standard boilerplate but I'm constantly surprised how well it understands my completely convoluted legacy architecture that barely I understand myself even though I'm the only contributor.
Post reply on HN