Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Magistral — the first reasoning model by Mistral AI

mistral.ai

Post reply on HN
Print view View original

141–150 of 444 posts

Re: Magistral — the first reasoning model by Mistral AI

#141

Post by mrtksn »

meta_ai_x wrote: post #125
mrtksn wrote: post #42

Earlier quoted context omitted.

Cool, which regulations exactly stopped you from doing cutting edge AI?

regulation-culture breed a certain type of risk-taking culture. So, you can't blame a specific regulation for lack of innovation culture

Im not sure about that, Europe has plenty of starups. Also, IIRC it has larger number of small businesses than US as in US huge companies employ huge numbers of people.

What Europe does not have is scale ups in tech. The tech consolidated in US. By tech I mean internet based companies. Remove those and EU has higher productivity.

Re: Magistral — the first reasoning model by Mistral AI

#142

Post by moffkalast »

segmondy wrote: post #87
pu_pe wrote: post #11

Benchmarks suggest this model loses to Deepseek-R1 in every one-shot comparison. Considering they were likely not even pitting it against the newer R1 version (no mention of that in the article) and at more than double the cost, this looks like the best AI company in the EU is struggling to keep up with the state-of-the-art.

are you really going to compare a 24B model to a 700B+ model?

The most important company is to is to QwQ at 30B sjnce it's still the best local reasoning model for that size. A comparison that Mistral did not run for some reason, not even with Qwen3.

Re: Magistral — the first reasoning model by Mistral AI

#143

Post by simianwords »

mrtksn wrote: post #21
pu_pe wrote: post #11

Benchmarks suggest this model loses to Deepseek-R1 in every one-shot comparison. Considering they were likely not even pitting it against the newer R1 version (no mention of that in the article) and at more than double the cost, this looks like the best AI company in the EU is struggling to keep up with the state-of-the-art.

Europe isn't going to catch up in tech as long as its market is open to US tech giants. Tech doesn't have marginal costs, so you want to have one of it in one place and sell it everywhere and when the infra and talent is already in US, EU tech is destined to do niche products. UK has a bit of it, France has some and that's it. The only viable alternatives are countries who have issues with US and that is China and Ru…

How can you explain Israel?

Re: Magistral — the first reasoning model by Mistral AI

#144

Post by micromacrofoot »

umbra07 wrote: post #136
micromacrofoot wrote: post #60

Earlier quoted context omitted.

I think usb-c and third party app stores are pretty cool

I think the government shouldn't be legislating that companies must use a specific USB connector. Realistically the legislation was only targeting Apple. If consumers want USB-C, then they can vote with their wallets and buy an Android, which is a reasonable alternative.

We've had multiple USB standards for decades with no end in sight. Apple was targeted because they have the most high-profile proprietary connector and they were generally using it to screw consumers. Good riddance.

Re: Magistral — the first reasoning model by Mistral AI

#145

Post by poorman »

arnaudsm wrote: post #18

I wished the charts included Qwen3, the current SOTA in reasoning. Qwen3-4B almost beats Magistral-22B on the 4 available benchmarks, and Qwen3-30B-A3B is miles ahead.

Is there a popular benchmark site people use? Becaues I had to test all these by hand and `Qwen3-30B-A3B` still seems like the best model I can run in that relative parameter space (/memory requirements).

Re: Magistral — the first reasoning model by Mistral AI

#146

Post by foolswisdom »

vikramkr wrote: post #38
mrtksn wrote: post #21

Earlier quoted context omitted.

Europe isn't going to catch up in tech as long as its market is open to US tech giants. Tech doesn't have marginal costs, so you want to have one of it in one place and sell it everywhere and when the infra and talent is already in US, EU tech is destined to do niche products. UK has a bit of it, France has some and that's it. The only viable alternatives are countries who have issues with US and that is China and Ru…

If you close off the market to US tech giants, maybe they'll have some amount of market dominance at home, but I would doubt that would mean they've "caught up" tech wise. There would be no incentive to compete. American EV manufacturing is pretty far behind Chinese EV manufacturing, protectionism didn't help make a competitive car, it just protected the home market while slowly ceding international market after inte…

The solution to that would be to force companies within the EU market to compete with each other (fair competition laws), just that idea is less popular than the first winner in a market ensuring they stay dominant (because it serves the interest of those who just got power). Same reason why big tech rules EU in the first place.

Re: Magistral — the first reasoning model by Mistral AI

#147

Post by atxtechbro »

simonw wrote: post #119

Here are my notes on trying this out locally via Ollama and via their API (and the llm-mistral plugin) too: https://simonwillison.net/2025/Jun/10/magistral/

Hi Simon,

What's the huge difference between the two pelicans riding bicycles? Was one running locally the small version vs the pretty good one running the bigger one thru the API?

Thanks, Morgan

Re: Magistral — the first reasoning model by Mistral AI

#148

Post by roboboffin »

syntex wrote: post #139
roboboffin wrote: post #92

Earlier quoted context omitted.

Not sure why I am being downvoted. I am simply saying that we know there is a defined algorithm for solving Tower of Hanoi, and the source code for it is widely available. So, o3 producing the code as an answer, demonstrates even less intelligence, as it means it is either memorized or copied from the internet. I don't see how this point counters the paper at all. I believe what they are trying to show in that paper,…

I didn't downvote. T the problem with the paper is that it asks the model to output all moves for, say, 15 disks 2 ^ 15 - 1 = 32767 32767 moves in a single prompt. That's not testing reasoning. That’s testing whether the model can emit a huge structured output without error, under a context window limit. The authors then treat failure to reproduce this entire sequence as evidence that the model can't reason. But that…

No worries, I wasn’t saying to you directly.

I agree 15 disks is very difficult for a human, probably on a sheer stamina level; but I managed to do 8 in about 15 minutes by playing around (I.e. no practice). They do state that there is a massive drop in performance at this point.

Re: Magistral — the first reasoning model by Mistral AI

#150

Post by ozgune »

danielhanchen wrote: post #3

I made some GGUFs for those interested in running them at https://huggingface.co/unsloth/Magistral-Small-2506-GGUF ollama run hf.co/unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL or ./llama.cpp/llama-cli -hf unsloth/Magistral-Small-2506-GGUF:UD-Q4_K_XL --jinja --temp 0.7 --top-k -1 --top-p 0.95 -ngl 99 Please use --jinja for llama.cpp and use temperature = 0.7, top-p 0.95! Also best to increase Ollama's context length…

Their benchmarks are interesting. They are comparing to DeepSeek-V3's (non-reasoning) December and DeepSeek-R1's January releases. I feel that comparing to DeepSeek-R1-0528 would be more fair.

For example, R1 scores 79.8 on AIME 2024, R1-0528 performs 91.4.

R1 scores 70 on AIME 2025, R1-0528 scores 87.5. R1-0528 does similarly better for GPQA Diamond, LiveCodeBench, and Aider (about 10-15 points higher).

https://huggingface.co/deepseek-ai/DeepSeek-R1-0528

Post reply on HN