Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral releases Devstral2 and Mistral Vibe CLI

mistral.ai

Post reply on HN
Print view View original

341–350 of 363 posts

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#341

Post by theshrike79 »

0cf8612b2e1e wrote: post #331
theshrike79 wrote: post #298

Earlier quoted context omitted.

The easiest way to fix these is give the model an environment to run code. Any model can easily one-shot a python script that can count the occurrence of any letter anywhere and return the result. It's just a tooling issue. You really can't "train" an LLM to do it because tokenisation and ... stuff.

I am not convinced they are executing code. Otherwise I would expect LLMs to not frequently guess the result of math questions. Of course you could train it. Some quick scripting to find all words with repeat letters, build up sample sentences (aardvark has three a,) and you have hard coded the answer to simple questions that make your LLM look stupid.

I have personally observed Grok running Python code in a chat to determine the current date so it could accurately tell me whether the 20th is a Friday (it wasn't in that specific month)

.. it did that in a story prompt that didn't happen in a) our world b) the current time =)

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#342

Post by tensor »

joseda-hg wrote: post #52
whimsicalism wrote: post #34

Earlier quoted context omitted.

That's fine, but I don't think you should call it open source or call it MIT or even 'modified MIT.' Call it Mistral license or something along those lines

That's probably better, but Modified MIT is pretty descriptive, I read it as "mostly MIT, but with caveats for extreme cases" which is about right, if you already know what the MIT license entails Whatever name they come up with for a new license will be less useful, because I'll have to figure out that this is what that is

To me this is highly misleading. The core idea behind MIT is that you can use it for anything, including commercial. A "you can use it for commercial only if you're revenue is small" is not remotely MIT-like. It's commercial with a freemium tier.

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#343

Post by simonw »

lacoolj wrote: post #336
simonw wrote: post #33

llm install llm-mistral llm mistral refresh llm -m mistral/devstral-2512 "Generate an SVG of a pelican riding a bicycle" https://tools.simonwillison.net/svg-render#%3Csvg%20xmlns%3D... Pretty good for a 123B model! (That said I'm not 100% certain I guessed the correct model ID, I asked Mistral here: https://x.com/simonw/status/1998435424847675429 )

How did you run a 123B model locally? Or did you do this on a GPU host somewhere? If so, what spec was it?

I haven't run the 123B one locally yet. I used Mistral's own API models for this.

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#344

Post by bakies »

sosodev wrote: post #182
bakies wrote: post #137

Earlier quoted context omitted.

I bought a framework desktop hoping to do this.

And it can do it, right? I think AMD AI Max line the first realistic offering for this type of thing. The Apple offerings are interesting but the lack of x86, Linux, and general compatibility make it hard sell imo.

Haven't started relying on it for anything but it does have decent performance at like 130b parameters. I also haven't tried to tune it at all. I saw some recommendations somewhere but I installed talos on it and didn't want to figure any of that out.

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#345

Post by [deleted] »

simonw wrote: post #312
armcat wrote: post #304

Earlier quoted context omitted.

Hi Simon! Love your work! Our of curiosity - how many pelican-cycling samples do you produce. Curious about the variance here. Thanks!

I've lost count, but there are 85 posts with that tag here: https://simonwillison.net/tags/pelican-riding-a-bicycle/ I need to extract them all into a formal collection.

[deleted]

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#346

Post by vidarh »

ido wrote: post #338
vidarh wrote: post #84

Earlier quoted context omitted.

I really do not want those things in Claude COde - I much prefer choosing my own diff tools etc. and running them in a separate terminal. If they start stuffing too much into the TUI they'd ruin it - if you want all that stuff built in, they have the VS Code integration.

using claude code via the VS Code plugin gives you side by side diffs as it works.

I very specifically do not want to run it in an IDE. I'm perfectly happy with it in the terminal, running diffs separately, and very specifically NOT as it is working.

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#347

Post by sosodev »

bakies wrote: post #344
sosodev wrote: post #182

Earlier quoted context omitted.

And it can do it, right? I think AMD AI Max line the first realistic offering for this type of thing. The Apple offerings are interesting but the lack of x86, Linux, and general compatibility make it hard sell imo.

Haven't started relying on it for anything but it does have decent performance at like 130b parameters. I also haven't tried to tune it at all. I saw some recommendations somewhere but I installed talos on it and didn't want to figure any of that out.

I just got my framework mainboard today. I haven't had a chance to set it up yet but from the research I've been doing it seems like Minimax M2 might be the best coding model for it at the moment. Similar performance to Devstral2 with only 10b active params.

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#348

Post by andai »

isodev wrote: post #189
andai wrote: post #40

Earlier quoted context omitted.

So people have different definitions of the word, but originally Vibe Coding meant "don't even look at the code". If you're actually making sure it's legit, it's not vibe coding anymore. It's just... Backseat Coding? ;) There's a level below that I call Power Coding (like power armor) where you're using a very fast model interactively to make many very small edits. So you're still doing the conceptual work of program…

I know tech bros like to come up with fancy words to make trivial things sounds fancy but as long as it’s a slop out process, it’s vibe coding. If you’re fixing what a bot spits out, should be a different word … something painful that could’ve been avoided? Also, we’re both “people in tech”, we know LLMs can’t conceptualise beyond finding the closest collection of tokens rhyming with your prompt/code. Doesn’t mean it…

Yeah, it's going on vibes. It's the Rick Rubin of programmers.

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#349

Post by andai »

brazukadev wrote: post #80
andai wrote: post #40

Earlier quoted context omitted.

So people have different definitions of the word, but originally Vibe Coding meant "don't even look at the code". If you're actually making sure it's legit, it's not vibe coding anymore. It's just... Backseat Coding? ;) There's a level below that I call Power Coding (like power armor) where you're using a very fast model interactively to make many very small edits. So you're still doing the conceptual work of program…

> If you're actually making sure it's legit, it's not vibe coding anymore. sorry to disappoint you but that is also been considered vibecoding. It is just not pejorative.

My meaning was that if we actually decide on definitions that make sense, for the specific things that different people are already doing, then there will be a lot less confusion on the matter!

Re: Mistral releases Devstral2 and Mistral Vibe CLI

#350

Post by InsideOutSanta »

Staross wrote: post #327
InsideOutSanta wrote: post #143

I gave Devstral 2 in their CLI a shot and let it run over one of my smaller private projects, about 500 KB of code. I asked it to review the codebase, understand the application's functionality, identify issues, and fix them. It spent about half an hour, correctly identified what the program did, found two small bugs, fixed them, made some minor improvements, and added two new, small but nice features. It introduced…

Also tried it on a small project, it did ok finding issues but completely failed doing rather basic edits, like it lost closing brackets or used wrong syntax and couldn't recover. The CLI was easy to setup and use though.

In my experience, the messed up closing brackets are a surprisingly common issue for LLMs. Both Sonnet 4.5 and Gemini 3 also do this regularly. Seems like something that should be relatively easy to fix, though.
Post reply on HN