41–50 of 297 posts
Does anyone actually uses these smaller models for coding? If so, how? I usually Opus everything. Is the play to plan/design/architect with a heavier model than delegate structured tasks to these smaller ones? Would appreciate to hear someone's opinion on having done and tested both paths.
Does anyone actually uses these smaller models for coding? If so, how? I usually Opus everything. Is the play to plan/design/architect with a heavier model than delegate structured tasks to these smaller ones? Would appreciate to hear someone's opinion on having done and tested both paths.
I use Gemini 3 Flash, I've seen the Claude Code setups, bullish on Anthropic people are driving up tokens but I am able to produce outcomes with a fraction of the money.
Performance doesn't seem that good:
- MAI-Code-1-Flash (137B-A5B) = 51% on SWE-bench pro
- Qwen3.6-35B-A3B = 49.5% on SWE-bench pro (https://huggingface.co/Qwen/Qwen3.6-35B-A3B)
They benchmark against Claude Haiku but Haiku is not good, it's worse than tiny open models you can run locally or via API at 10% the cost.
Does anyone actually uses these smaller models for coding? If so, how? I usually Opus everything. Is the play to plan/design/architect with a heavier model than delegate structured tasks to these smaller ones? Would appreciate to hear someone's opinion on having done and tested both paths.
The introductory blog post has a lot more information https://microsoft.ai/news/introducingmai-code-1-flash/ and the model card https://microsoft.ai/pdf/MAI-Code-1-Flash-Model-Card.PDF The broader announcement of 7 MAI models seems to be where the 5B active in the title comes from https://microsoft.ai/news/building-a-hillclimbing-machine-la...
Earlier quoted context omitted.
I use Gemini 3 Flash, I've seen the Claude Code setups, bullish on Anthropic people are driving up tokens but I am able to produce outcomes with a fraction of the money.
Do you mind sharing your workflow? What do you mean by fraction of the money, in my case personally, I'm yet to reach a session limit on the subscription plan. I'm not "tokenmaxxing" as they say, so hard to see a scenario in which the plan is expensive for the value I get.
For example you probably don't have days where you ask Opus to review your whole code base and look for code duplication/technical debt/robustness issues, and then to fix some of the found issues, and do this 3-5 times until no big issues are found anymore.
Earlier quoted context omitted.
It’s about bang for buck. That high a score for 5B params is pretty good, nigh unbelievable a short while ago. It is my belief that smaller models will get better and better, and even cloud SOTA models will shrink. Yet another reason the current buildout will feel like the railroads.
Yeah the future is probably a number of highly specialised small models you can run on your own hardware rather than massive frontier models in the cloud. That's what I'm betting on anyway.
That scroll effect is jank city for me (yeah yeah works fine in Chrome/Edge).
But it seems like, by and large, even the faster models are now aimed at longer-running agentic flows and not sub-1s autocomplete. Or am I wrong about that?