VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
1–10 of 226 posts
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#2[deleted]
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#3[flagged]
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#4I tried generating the classic pelican svg, but it failed horribly just showing me a rectangle and a black circle...
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#5I tried generating the classic pelican svg, but it failed horribly just showing me a rectangle and a black circle...
That’s all I needed to hear
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#6I tried generating the classic pelican svg, but it failed horribly just showing me a rectangle and a black circle...
Its for reasoning not generating art?
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#7Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#8Having some success while testing this model out as a replacement for GPT-5 nano in source code security review. Running on RTX 3090 (24 GB VRAM) via vLLM. It's not great on structured output (as noted in the model card) but I'm working around that in my harness.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#9I tried generating the classic pelican svg, but it failed horribly just showing me a rectangle and a black circle...
I think this is predicted? Part of the story is how they were able to preserve core reasoning ability while cutting knowledge like "pelicans have wings."
> these findings motivate the Parametric Compression-Coverage Hypothesis, which views verifiable reasoning as compressible into compact reasoning cores, while open-domain knowledge and general-purpose competence require broad parameter coverage over facts, concepts, and long-tail scenarios.
Re: VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPO
#10Earlier quoted context omitted.
Its for reasoning not generating art?
Can you explain this a bit more
Imagine you want to make a smaller model that is really good at one thing, say, driving a car. You could remove the parameters that lead it to correctly answer, "What is the powerhouse of the cell?" or, "Who was the first president of the United States?"
It would look really dumb if someone asked it that, but that's fine. You're trying to make a model that is optimized for efficiency for a specific task. As much as possible, you should prune uncorrelated things.