[flagged]
VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
71–80 of 226 posts
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#72Earlier quoted context omitted.
Until they reverse on a highway and kill a family. Being able to drive isn't where parent poster put the bar
I don't see what reading has to do with knowing not to reverse on a highway. It's not like they put up big glowing signs that say "wrong way" like in a video game.
I agree that drivers should know not to reverse on a highway regardless of local signage.
But in situations that could be ambiguous, I think this is a regional difference - the US, Australia, part of the rest of the Americas use lots of text on road signs (including literal "wrong way" signs); Europe and much of the rest of the world use far less text (including purely pictographic "wrong way" signs). Especially important in Europe where drivers just can't learn 20+ languages.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#73[flagged]
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#74[flagged]
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#75[flagged]
[flagged]
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#76Earlier quoted context omitted.
I don't see what reading has to do with knowing not to reverse on a highway. It's not like they put up big glowing signs that say "wrong way" like in a video game.
In Australia, you will see signs on freeway offramps pointing to any cars attempting to drive on to the freeway 'WRONG WAY GO BACK' [0] Though it is true you don't need to be able to read to operate a vehicle, you /do/ need to be able to read to operate a vehicle safely. And for those who can read: could you teach someone how to drive using an LLM? Sure. Safely? Probably not. [0] https://www.transport.nsw.gov.au/oper…
Most of the world follows the Vienna Convention on Road Signs and Signals, where all the important road signs are understandable without reading. This is how no entry signs look around the world [1]
Especially important in places like Europe, where it's common for the driver to be able to read, but unable to speak the language of the country they are currently driving through. I can't speak any Polish, but can travel on Polish roads just fine
1: https://en.wikipedia.org/wiki/Prohibitory_traffic_sign#No_en...
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#77Am I right in thinking this is a tiny model which has been trained well to reason, and that's it? Makes me think of a smart person who doesn't know anything about a given topic, but with the right tools will go and research the heck out of it. I really like the sound of this... why have models train on learning anything when you can just train them how to learn and let them get on with it from something as small as a…
This has been my dream ever since. Instead of encoding "all the knowledge" into those parameters, how about just making a model that has the same size, but all (or rather most) it does is reasoning? Just give it the ability to browse the net (e.g. language specifications, documentation and best practices) and just have it do its thing. Why does my coding agent need to know the population of New York, know a cheese ca…
I think this is a well known concept, which we can't deliver yet. LLM/transformer give us reasoning engine as a byproduct of its design, but it is quite ineffective. If we can distill reasoning, if reasoning can be achieved without general knowledge, it will be a very effective machine.
Some amount of knowledge is required for reasoning. Maybe such model can dynamically knowledge domains to have taxonomy. For example, model can't effective reason about development task, if it has no knowledge about development best practices. But population of New York or recipies can definitely be loaded run time with tools.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#78Earlier quoted context omitted.
I mean, this really doesn't sound useful even if LLMs worked that way. First, if you know nothing you don't even know what you're missing or what to search for. Then, without unlimited context, you have to do research for every task all over again every time.
> First, if you know nothing you don't even know what you're missing or what to search for. RAG on the initial prompt would be the first thing to try. > Then, without unlimited context, you have to do research for every task all over again every time. Thing is, we're really really good at building very fast search engines. Doing research all over again every time shouldn't be a problem.
Couldn't you build some internal knowledge that would stay and you could teach a model this way. A very fast local memory of some sort. You could also specialize model this way so it is very skilled in your domain. The more you use it, the smarter it gets. I guess the problem is for the model to decide whether the information stored in memory is sufficient or not.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#79Earlier quoted context omitted.
This has been my dream ever since. Instead of encoding "all the knowledge" into those parameters, how about just making a model that has the same size, but all (or rather most) it does is reasoning? Just give it the ability to browse the net (e.g. language specifications, documentation and best practices) and just have it do its thing. Why does my coding agent need to know the population of New York, know a cheese ca…
Education had this sad 15 year period where it thought “competences” are all you need. Turns out that without the world knowledge to have a base of facts, it is not.
Basically: you can't teach people to think without giving them some facts and ideas to think with. It's like trying to teach woodworking without giving the students any wood.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#80Am I right in thinking this is a tiny model which has been trained well to reason, and that's it? Makes me think of a smart person who doesn't know anything about a given topic, but with the right tools will go and research the heck out of it. I really like the sound of this... why have models train on learning anything when you can just train them how to learn and let them get on with it from something as small as a…
"The right tools" in this case might presumably include, eg, a set of repos + docs and specs on the various technologies being used. Or a library of text/images and background docs on style and techniques use to create them.
That plus this model should give you a very powerful and focussed assistant.