Earlier quoted context omitted.
We are getting to the point that its not unreasonable to think that "Generate an SVG of a pelican riding a bicycle" could be included in some training data. It would be a great way to ensure an initial thumbs up from a prominent reviewer. It's a good benchmark but it seems like it would be a good idea to include an additional random or unannounced similar test to catch any benchmaxxing.
If this had any substance then it could be criticized, which is what they're trying to avoid.
Mistral releases Devstral2 and Mistral Vibe CLI
201–210 of 363 posts
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#202Earlier quoted context omitted.
I think Aider is closest to what you want. The chat interface is optimal to me because you often are asking questions and seeking guidance or proposals as you are making actual code changes. On reason I do like it is that its default mode of operation is to make a commit for each change it makes. So it is extremely clear what the AI did vs what you did vs what is a hodge podge of both. As others have mentioned, you c…
Aider can be a chat interface and it's great for that but you can also use it from your editor by telling it to watch your files.[1] So you'd write a function name and then tell it to flesh it out. function factorial(n) // Implement this. AI! Becomes: function factorial(n) { if (n === 0 || n === 1) { return 1; } else { return n \* factorial(n - 1); } } Last I looked Aider's maintainer has had to focus on other things…
Very much this for me - I really don't get why, given a new models are popping out every month from different providers, people are so happy to sink themselves into provider ecosystems when there are open source alternatives that work with any model.
The main problem with Aider is it isn't agentic enough for a lot of people but to me that's a benefit.
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#203Earlier quoted context omitted.
> run locally for agentic coding. Nowadays I mostly use GPT-OSS-120b for this What kind of hardware do you have to be able to run a performant GPT-OSS-120b locally?
RTX Pro 6000, ends up taking ~66GB when running the MXFP4 native quant with llama-server/llama.cpp and max context, as an example. Guess you could do it with two 5090s with slightly less context, or different software aimed at memory usage efficiency.
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#204I'm glad it's not another LLM CLI that uses React. Vibe-cli seems to be built with https://github.com/textualize/textual/
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#205I'm glad it's not another LLM CLI that uses React. Vibe-cli seems to be built with https://github.com/textualize/textual/
I'm not excited that it's done in python. I've had experience with Aider struggling to display text as fast as the llm is spitting it out, though that was probably 6 months ago now.
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#206Extremely happy with this release, the previous Devstral was great but training it for open hands crippled the usefulness. Having their own CLI dev tool will hopefully be better
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#207Let's say you had a hardware budget of $5,000. What machine would you buy or build to run Devstral Small 2? The HuggingFace page claims it can run on a Mac with 32 GB of memory or an RTX 4090. What kind of tokens per second would you get on each? What about DGX Spark? What about RTX 5090 or Pro series? What about external GPUs on Oculink with a mini PC?
48GB of vram and lots of cuda cores, hard to beat this value atm.
If you want to go even further, you can get an 8x V100 32GB server complete with 512GB ram and nvlink switching for $7000 USD from unixsurplus (ebay.com/itm/146589457908) which can run even bigger models and with healthy throughput. You would need 240V power to run that in a home lab environment though.
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#208The system prompt and tool prompts for their open source (Apache 2 licensed) Python+Textual+Pydantic CLI tool are fun to read: core/prompts/cli.md https://github.com/mistralai/mistral-vibe/blob/v1.0.4/vibe/c... core/prompts/compact.md https://github.com/mistralai/mistral-vibe/blob/v1.0.4/vibe/c... .../prompts/bash.md https://github.com/mistralai/mistral-vibe/blob/v1.0.4/vibe/c... .../prompts/grep.md https://github.co…
Based on your experience with Claude Code, how does Mistral Vibe compare?
Here's n example of the kinds of things I do with Claude Code now: https://gistpreview.github.io/?b64d5ee40439877eee7c224539452... - that one involved several from-scratch rewrites of the history of an entire Git repo just because I felt like it.
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#209Earlier quoted context omitted.
Condescending and disrespectful to whom? Everybody wholsale? This doesnt seem reasonable? Please elaborate.
Not sure if I'd use the same descriptions so pointedly , but I can see what they mean. It's perfectly fine to link for convenience, but it does feel a little disrespectful/SEO-y to not 'continue the conversation' . A summary in the very least, how exactly it pertains. Sell us. In a sense, link-dropping [alone] is saying: "go read this and establish my rhetorical/social position, I'm done here" Imagine meeting an auth…
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#210Earlier quoted context omitted.
I'd throw a 7900xtx in an AM4 rig with 128gb of ddr4 (which is what I've been using for the past two years) Fuck nvidia
You know, I haven't even been thinking about those AMD gpus for local llms and it is clearly a blind spot for me. How is it? I'd guess a bunch of the MoE models actually run well?