Benchmarks suggest this model loses to Deepseek-R1 in every one-shot comparison. Considering they were likely not even pitting it against the newer R1 version (no mention of that in the article) and at more than double the cost, this looks like the best AI company in the EU is struggling to keep up with the state-of-the-art.
Magistral — the first reasoning model by Mistral AI
11–20 of 444 posts
Re: Magistral — the first reasoning model by Mistral AI
#12How many other open-weights reasoning models are there?
Is it possible to run multiple reasoning models on one problem? (Why not? I guess).
Another funny thought is: they release their Small model, and kept their Medium as a premium service. I wonder if you could do chains with Medium run occasionally, linked together by local runs of Small?
Re: Magistral — the first reasoning model by Mistral AI
#13So, worse than R1, and only 24B version is open weights? NGMI. R1 is awesome, and full 630B version is open.
Re: Magistral — the first reasoning model by Mistral AI
#14The Magistral Small can fit within a single RTX 4090 or a 32GB RAM MacBook once quantized.
Re: Magistral — the first reasoning model by Mistral AI
#15Benchmarks suggest this model loses to Deepseek-R1 in every one-shot comparison. Considering they were likely not even pitting it against the newer R1 version (no mention of that in the article) and at more than double the cost, this looks like the best AI company in the EU is struggling to keep up with the state-of-the-art.
"EU is leading in regulation", they say.
I don't know what they are thinking.
Re: Magistral — the first reasoning model by Mistral AI
#16Interesting that their niche seems to be small parameter models.
Re: Magistral — the first reasoning model by Mistral AI
#17Would be interesting to see a comparison with Qwen 32B. I found it a fantastic local model (ollama).
I agree. Qwen models are great.
Re: Magistral — the first reasoning model by Mistral AI
#18I wished the charts included Qwen3, the current SOTA in reasoning.
Qwen3-4B almost beats Magistral-22B on the 4 available benchmarks, and Qwen3-30B-A3B is miles ahead.
Re: Magistral — the first reasoning model by Mistral AI
#19The featured accuracy benchmarks exclude every model that matter except DeepSeek, which is quite telling about this new model's performance.
This makes it yet another example of European companies building great products but fumbling marketing.
Mistral's edge is speed. It's a real pleasure to use because it answers in ~1s what takes other models 5-8s, which makes for a much better experience. But instead of focusing on it, they bury it far down the post.
Try it and see if you like the speed! Note that the speed advantage only applies to queries that don't require web-search, as Mistral is significantly slower on this one, leading to a ~5 seconds advantage over 2 minutes of research for the queries I benchmarked with Grok.
Re: Magistral — the first reasoning model by Mistral AI
#20Benchmarks suggest this model loses to Deepseek-R1 in every one-shot comparison. Considering they were likely not even pitting it against the newer R1 version (no mention of that in the article) and at more than double the cost, this looks like the best AI company in the EU is struggling to keep up with the state-of-the-art.
"EU is leading in regulation", they say. I don't know what they are thinking.
probably some silly thing like "people should have more rights and protections"