Earlier quoted context omitted.
SVG is a current standard. Do not be coy just to satisfy your urge to disagree.
The point stands. Whether or not the standard is current has no relevance for the ability of the "AI" to produce the requested content. Either it can or can't.
Mistral releases Devstral2 and Mistral Vibe CLI
131–140 of 363 posts
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#132llm install llm-mistral llm mistral refresh llm -m mistral/devstral-2512 "Generate an SVG of a pelican riding a bicycle" https://tools.simonwillison.net/svg-render#%3Csvg%20xmlns%3D... Pretty good for a 123B model! (That said I'm not 100% certain I guessed the correct model ID, I asked Mistral here: https://x.com/simonw/status/1998435424847675429 )
We are getting to the point that its not unreasonable to think that "Generate an SVG of a pelican riding a bicycle" could be included in some training data. It would be a great way to ensure an initial thumbs up from a prominent reviewer. It's a good benchmark but it seems like it would be a good idea to include an additional random or unannounced similar test to catch any benchmaxxing.
[deleted]
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#133Less than a year behind the SOTA, faster, and cheaper. I think Mistral is mounting a good recovery. I would not use it yet since it is not the best along any dimension that matters to me (I'm not EU-bound) but it is catching up. I think its closed source competitors are Haiku 4.5 and Gemini 3 Pro Fast (TBA) and whatever ridiculously-named light model OpenAI offers today (GPT 5.1 Codex Max Extra High Fast?)
The OpenAI thing is named Garlic. (Surely they won't release it like that, right..?)
TIL: https://garlicmodel.com/
That looks like the next flagship rather than the fast distillation, but thanks for sharing.
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#134llm install llm-mistral llm mistral refresh llm -m mistral/devstral-2512 "Generate an SVG of a pelican riding a bicycle" https://tools.simonwillison.net/svg-render#%3Csvg%20xmlns%3D... Pretty good for a 123B model! (That said I'm not 100% certain I guessed the correct model ID, I asked Mistral here: https://x.com/simonw/status/1998435424847675429 )
We are getting to the point that its not unreasonable to think that "Generate an SVG of a pelican riding a bicycle" could be included in some training data. It would be a great way to ensure an initial thumbs up from a prominent reviewer. It's a good benchmark but it seems like it would be a good idea to include an additional random or unannounced similar test to catch any benchmaxxing.
I wrote about that possibility here: https://simonwillison.net/2025/Nov/13/training-for-pelicans-...
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#135llm install llm-mistral llm mistral refresh llm -m mistral/devstral-2512 "Generate an SVG of a pelican riding a bicycle" https://tools.simonwillison.net/svg-render#%3Csvg%20xmlns%3D... Pretty good for a 123B model! (That said I'm not 100% certain I guessed the correct model ID, I asked Mistral here: https://x.com/simonw/status/1998435424847675429 )
but can it recreate the spacejam 1996 website? https://www.spacejam.com/1996/jam.html
in case folks are missing the context
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#136Let's say you had a hardware budget of $5,000. What machine would you buy or build to run Devstral Small 2? The HuggingFace page claims it can run on a Mac with 32 GB of memory or an RTX 4090. What kind of tokens per second would you get on each? What about DGX Spark? What about RTX 5090 or Pro series? What about external GPUs on Oculink with a mini PC?
I'd throw a 7900xtx in an AM4 rig with 128gb of ddr4 (which is what I've been using for the past two years)
Fuck nvidia
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#137Let's see which company becomes the first to sell "coding appliances": hardware with a model good enough for normal coding. If Mistral is so permissive they could be the first ones, provided that hardware is then fast/cheap/efficient enough to create a small box that can be placed in an office. Maybe in 5 years.
I bought a framework desktop hoping to do this.
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#138Earlier quoted context omitted.
We are getting to the point that its not unreasonable to think that "Generate an SVG of a pelican riding a bicycle" could be included in some training data. It would be a great way to ensure an initial thumbs up from a prominent reviewer. It's a good benchmark but it seems like it would be a good idea to include an additional random or unannounced similar test to catch any benchmaxxing.
I wrote about that possibility here: https://simonwillison.net/2025/Nov/13/training-for-pelicans-...
[flagged]
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#139Earlier quoted context omitted.
The OpenAI thing is named Garlic. (Surely they won't release it like that, right..?)
TIL: https://garlicmodel.com/ That looks like the next flagship rather than the fast distillation, but thanks for sharing.
Lol, someone vibecoded an entire website for OpenAI's model, that's some dedication.
Re: Mistral releases Devstral2 and Mistral Vibe CLI
#140Let's say you had a hardware budget of $5,000. What machine would you buy or build to run Devstral Small 2? The HuggingFace page claims it can run on a Mac with 32 GB of memory or an RTX 4090. What kind of tokens per second would you get on each? What about DGX Spark? What about RTX 5090 or Pro series? What about external GPUs on Oculink with a mini PC?
I'd throw a 7900xtx in an AM4 rig with 128gb of ddr4 (which is what I've been using for the past two years) Fuck nvidia
Get a Radeon AI Pro r9700! 32GB of RAM