Earlier quoted context omitted.
No, thanks, we don't want to be like EU. Everything regulated to death. They even thought to criminalize street photography because there could be copyrighted materials in the picture. Not sure, are they still taxing Eiffel tower images?
EU is not a monolithic entity, and amount of regulation varies widely. Baltics are very business friendly, for example.
Magistral — the first reasoning model by Mistral AI
161–170 of 444 posts
Re: Magistral — the first reasoning model by Mistral AI
#162I made some GGUFs for those interested in running them at https://huggingface.co/unsloth/Magistral-Small-2506-GGUF ollama run hf.co/unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL or ./llama.cpp/llama-cli -hf unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL --jinja --temp 0.7 --top-k -1 --top-p 0.95 -ngl 99 Please use --jinja for llama.cpp and use temperature = 0.7, top-p 0.95! Also best to increase Ollama's context length…
Their paper https://mistral.ai/static/research/magistral.pdf is also cool! They edited GRPO via: 1. Removed KL Divergence 2. Normalize by total length (Dr. GRPO style) 3. Minibatch normalization for advantages 4. Relaxing trust region
The paper they cite "What matters in on-policy RL" claims it does not lead to much difference on their suite of test problems, and (mean-of-minibatch)-normalization doesn't seem theoretically motivated for convergence to the optimal policy?
Re: Magistral — the first reasoning model by Mistral AI
#163Earlier quoted context omitted.
it's bizarre. the first sentence is "Announcing Magistral — the first reasoning model by Mistral AI — excelling in domain-specific, transparent, and multilingual reasoning." and those should clearly be comma and this sentence is just flat out wrong "Lack of specialized depth needed for domain-specific problems, limited transparency, and inconsistent reasoning in the desired language — are just some of the known limit…
really? i would have written it the exact same way (with dashes instead of commas).
Re: Magistral — the first reasoning model by Mistral AI
#164Is the number of em-dashes in this marketing copy indicative of the kind of output that the model produces? If so, might want to tone it down a bit.
Re: Magistral — the first reasoning model by Mistral AI
#165Earlier quoted context omitted.
As a counterexample, China's tech industry has caught up and in some ways surpassed the US, partially due to being closed off.
> As a counterexample, China's tech industry has caught up and in some ways surpassed the US, partially due to being closed off. How did you come up to that conclusion? We don't have access to an alternate universe where the Chinese tech market was open. There is a real possibility that it would have been far ahead had it been open.
Re: Magistral — the first reasoning model by Mistral AI
#166Here are my notes on trying this out locally via Ollama and via their API (and the llm-mistral plugin) too: https://simonwillison.net/2025/Jun/10/magistral/
Hi Simon, What's the huge difference between the two pelicans riding bicycles? Was one running locally the small version vs the pretty good one running the bigger one thru the API? Thanks, Morgan
Mistral's API defaults to `magistral-medium-2506` right now, which is running with full precision, no quantization.
Re: Magistral — the first reasoning model by Mistral AI
#167Earlier quoted context omitted.
Ok, just a quick question… why does Europe not have the money actual/people?
Part of the answer is debt. The U.S. has a debt of 35Tn. The entire EU around 16Tn. If even 10% of the debt difference was invested in tech that would have meant about $2tn more in investment in EU tech.
EU is not a business-friendly environment.
Re: Magistral — the first reasoning model by Mistral AI
#168Earlier quoted context omitted.
24B is the size of the Small opensourced model. The Medium model is bigger (they don't seem to disclose its size) and still gets beaten by Deepseek R1
Mistral Large is 123b so one can probably assume that medium is between 24b and 123b, also Mistral 3.1 is by a wide margin my go-to model in real life situations. Benchmarks absolutely don't tell the whole story, and different models have different use cases.
Re: Magistral — the first reasoning model by Mistral AI
#169Earlier quoted context omitted.
Tool calling isn't enabled in the official Magistral Small GGUF (or the Ollama one) which is sad. Hope they (or someone else) fix that soon.
They have already released Devstral, which is a tool-specific finetune of the same base model. That works pretty well with cline (even though it was specifically tuned for open-hands). This would likely be a good model for the "plan" mode in various agentic tools (cline, aider, cursor/windsurf/void, etc). So you'd have a chat in plan mode, then use devstral to actually implement that plan.
Re: Magistral — the first reasoning model by Mistral AI
#170Earlier quoted context omitted.
"EU is leading in regulation", they say. I don't know what they are thinking.
This is why I want to move to the EU. I don’t care if companies aren’t coddled there. I want to live where people are the first priority.
This is not coincidental.