> Qwen flash-next and GLM 5.3 to show some of the other strong open weight models, and they predictably dominate it
Absolutely - no argument from me here. Bigger is very clearly a lever you can pull to get more out of a model.
> But then scroll down and hit Time Per Task, and you'll see that DSv4 Flash takes 3.6 seconds per task to Qwen's 21.1
Fair point, qwen definitely is slower - it’s a dense model, 27b params, vs a sparse 13b active params model - but the data doesn’t quite agree with what you’re saying about reasoning. I.e.:
> It can make up for its shortcomings by iterating a lot longer, and using way more thinking tokens
If you look at the total tokens generated, deepseek thought for 45k tokens and qwen thought for 48k. Barely a difference. The wall clock difference is all down to the speed of token generation, not the amount of reasoning done. At least when we are comparing deepseek and qwen 27b. The comparison swings more towards your position when it comes to the other models on the chart that reason for much fewer tokens.
So perhaps a hypothetical Qwen-27b-a13b could never rival deepseek’s larger model and the tradeoff is one of speed vs overall size - i.e. a small model needs more active params to compete than a big one does.
One data point that seems relevant to me is that the previous gen qwen Qwen3.6-27b was not so different in performance from its sibling model Qwen3.6-35b-a3b. We never got a qwen3.8-35b-a3b, but if we had, would the gap have stayed the same or gotten bigger? I.e. would the quality gains by improving training coming up against a hard limitation with 35b, or not.