[flagged]
VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
61–70 of 226 posts
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#62There is some base level of intelligence any model needs to be useful, even in narrow tasks. Could you teach a 5 year old to drive a car? A 10 year old? A 12 year old? To drive a car requires being able to read, to have judgement about ice or rainy conditions, to anticipate a child running after a ball. By the time a human in in their mid teens they have acquired the base knowledge... Small models need to have enough…
Ask people who grew up on a farm in a rural area. Sometimes you have to even if you can't and you do.
I was driving a tractor since 12, including on the road with small farm equipment, and indeed, mostly out of the necessity, but I also received a lot of tuition (from licenced drivers) to know how to behave.
Different times though.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#63If you could pair it somehow with a model that can code and describe code this could be a very powerful combo.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#64Note that these are Python-only results, the model will not do as well with other languages. I'm glad to see more domain-focused SLMs, we need more of them! A programming focused MoE should work well across many languages.
Lots of confusion about what this model is actually focused on. It is a cheap specialist for closed-world, verifiable reasoning tasks like math, self-contained coding problems, and similar. "Closed-world" means the needed information is already in the context. It is not a tool-using agent that can discover missing context. "Verifiable" means answers are hard to generate but easy to check. So no open ended research, r…
If it can code well then once you put it in a loop with an interpreter it can do anything.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#65Earlier quoted context omitted.
This has been my dream ever since. Instead of encoding "all the knowledge" into those parameters, how about just making a model that has the same size, but all (or rather most) it does is reasoning? Just give it the ability to browse the net (e.g. language specifications, documentation and best practices) and just have it do its thing. Why does my coding agent need to know the population of New York, know a cheese ca…
I mean, this really doesn't sound useful even if LLMs worked that way. First, if you know nothing you don't even know what you're missing or what to search for. Then, without unlimited context, you have to do research for every task all over again every time.
The model they built knows a fair bit apparently. You can't get 94.3 on AIME26 knowing nothing.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#66There is some base level of intelligence any model needs to be useful, even in narrow tasks. Could you teach a 5 year old to drive a car? A 10 year old? A 12 year old? To drive a car requires being able to read, to have judgement about ice or rainy conditions, to anticipate a child running after a ball. By the time a human in in their mid teens they have acquired the base knowledge... Small models need to have enough…
> To drive a car requires being able to read, to have judgement about ice or rainy conditions, to anticipate a child running after a ball.
Conflation. That's to drive a car safely. To just drive a car one only need know to press gas to move, press brake to stop, turn steering wheel to change direction and maybe use a gear stick to shift into drive/park (car can be modified to abstract that away). Not much more complex than riding a bicycle; maybe even less since no need to learn to balance.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#67I recently came across this model and I would love to try it with my coding agent soon.
I really like the idea of small models that can reason but do not have too much knowledge. Also, no emphasis on tool calls. I think the agent should do the heavy lifting and reach half way.
I use really small models, like Qwen 3.5 0.8B to 9B - no tool calling, no MCP, no skills, nothing. No multi-turn chat even. Models are given very specific tasks using a vast number of system prompts and all the response handling is done in the agent(s).
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#683B param on par with opus 4.5 sounds interesting. Will read the full article before making my mind
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#69Earlier quoted context omitted.
Until they reverse on a highway and kill a family. Being able to drive isn't where parent poster put the bar
I don't see what reading has to do with knowing not to reverse on a highway. It's not like they put up big glowing signs that say "wrong way" like in a video game.
There literally are "no u turn" signage where you are supposed not to do that. They literally put up signs for it. It is not glowing in the sky, and it doesnt need to be, and doesnt help making a point strawmanning it.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#70Earlier quoted context omitted.
Until they reverse on a highway and kill a family. Being able to drive isn't where parent poster put the bar
I don't see what reading has to do with knowing not to reverse on a highway. It's not like they put up big glowing signs that say "wrong way" like in a video game.
In Australia, you will see signs on freeway offramps pointing to any cars attempting to drive on to the freeway 'WRONG WAY GO BACK' [0]
Though it is true you don't need to be able to read to operate a vehicle, you /do/ need to be able to read to operate a vehicle safely.
And for those who can read: could you teach someone how to drive using an LLM? Sure. Safely? Probably not.
[0] https://www.transport.nsw.gov.au/operations/roads-and-waterw...