SLM when trained for single use case often beats the LLM. That's both the advantage and limitation.
VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
111–120 of 226 posts
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#112Am I right in thinking this is a tiny model which has been trained well to reason, and that's it? Makes me think of a smart person who doesn't know anything about a given topic, but with the right tools will go and research the heck out of it. I really like the sound of this... why have models train on learning anything when you can just train them how to learn and let them get on with it from something as small as a…
This has been my dream ever since. Instead of encoding "all the knowledge" into those parameters, how about just making a model that has the same size, but all (or rather most) it does is reasoning? Just give it the ability to browse the net (e.g. language specifications, documentation and best practices) and just have it do its thing. Why does my coding agent need to know the population of New York, know a cheese ca…
[deleted]
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#113Earlier quoted context omitted.
Yeah, if they can fit an 8B model that's really good at improving the output by thinking, running at 16K tok/s on Taalas would be mind-blowing.
Given this and the quality of open models, it makes no sense to me that there’s a future for Anthropic et all?
Packaging a capability into a consumable form will still be business.
It's like web hosting; all the open source tools are there and free, and yet website tools, hosts, etc flourish.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#114I have been thinking about how to use this. Since it doesn’t support tool calling I have been considering a dual model deployment, where a small tool calling llm drives the majority of the user experience, and vibe thinker is tapped for reasoning by the other llm. So who has suggestions on small models with excellent tool calling capabilities?
Gemma 4 E4B and Qwen 3 4B are pretty good, but fine-tuning makes them really good. There are tradeoffs at this size, so you'll have to find (or make) a finetune that does what you need.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#115Am I right in thinking this is a tiny model which has been trained well to reason, and that's it? Makes me think of a smart person who doesn't know anything about a given topic, but with the right tools will go and research the heck out of it. I really like the sound of this... why have models train on learning anything when you can just train them how to learn and let them get on with it from something as small as a…
This has been my dream ever since. Instead of encoding "all the knowledge" into those parameters, how about just making a model that has the same size, but all (or rather most) it does is reasoning? Just give it the ability to browse the net (e.g. language specifications, documentation and best practices) and just have it do its thing. Why does my coding agent need to know the population of New York, know a cheese ca…
Any sufficiently general superintelligence will deduce the existence of rice pudding and income tax from Cartesian first principles.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#116What is the idiots guude to run this one local now?
omlx makes it quite easy
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#117Looks like we are seeing small but mighty model breakthroughs, outpacing the pure capital firepower of SOTA providers. I love rooting for the little guy, but is it too soon to call it? To play devils advocate, could it just be the benchmarks are not efficient enough to capture success of real developer workflows?
I've just started using qwen3.6:35b a couple days ago running on my framework desktop and rather impressed. It runs really well and reminds me of probably the first Claude model I used. It's the first local model that's actually working for me in a coding agent I've tried. Very exciting!
Try 27b, it's significantly smarter than 35b-a3b (although it is slower, it's not so bad with MTP).
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#118Earlier quoted context omitted.
Lots of confusion about what this model is actually focused on. It is a cheap specialist for closed-world, verifiable reasoning tasks like math, self-contained coding problems, and similar. "Closed-world" means the needed information is already in the context. It is not a tool-using agent that can discover missing context. "Verifiable" means answers are hard to generate but easy to check. So no open ended research, r…
To follow up on this, I had it solve a nasty ODE problem that I saw in the recent Mathematica 15 release post: Solve the following first-order ODE for f(x): ((-1 - 2*x)*f(x)*tan(1 + x - exp(-61 - 2*x)*f(x)/x) + exp(61 + 2*x)*x*(1 - x*tan(1 + x - exp(-61 - 2*x)*f(x)/x)) + x*tan(1 + x - exp(-61 - 2*x)*f(x)/x)*f'(x)) = 0 Find the general solution f(x). And surprisingly it found a valid solution! Extra impressive because…
Qwen 3.5 9B Q4_K_M solved this using 10K tokens in 5 mins on a RX 7600.
The answer is exactly what you have posted. I am impressed by Qwen!
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#119Earlier quoted context omitted.
Given this and the quality of open models, it makes no sense to me that there’s a future for Anthropic et all?
Packaging a capability into a consumable form will still be business. It's like web hosting; all the open source tools are there and free, and yet website tools, hosts, etc flourish.
It’s true, but hosting prices are still within spitting distance of rolling it yourself.
SOTA providers are expecting some level of margin. Companies everywhere have a tight eye on their AI bills right now.
The motivation is there if the models get good enough, even if it’s more painful.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#120Looks like we are seeing small but mighty model breakthroughs, outpacing the pure capital firepower of SOTA providers. I love rooting for the little guy, but is it too soon to call it? To play devils advocate, could it just be the benchmarks are not efficient enough to capture success of real developer workflows?
It feels sometimes like optimizations are only starting.