141–150 of 226 posts
Looks like we are seeing small but mighty model breakthroughs, outpacing the pure capital firepower of SOTA providers. I love rooting for the little guy, but is it too soon to call it? To play devils advocate, could it just be the benchmarks are not efficient enough to capture success of real developer workflows?
Earlier quoted context omitted.
I've just started using qwen3.6:35b a couple days ago running on my framework desktop and rather impressed. It runs really well and reminds me of probably the first Claude model I used. It's the first local model that's actually working for me in a coding agent I've tried. Very exciting!
Could you please share which coding agent you are using with it?
The Q8_K_XL MTP model from Unsloth: https://huggingface.co/unsloth/Qwen3.6-35B-A3B-MTP-GGUF
Am I right in thinking this is a tiny model which has been trained well to reason, and that's it? Makes me think of a smart person who doesn't know anything about a given topic, but with the right tools will go and research the heck out of it. I really like the sound of this... why have models train on learning anything when you can just train them how to learn and let them get on with it from something as small as a…
So if you don't train it on a large dataset of a lot of words with a lot of sensible connections, it won't be able to reason, as it won't be able to make proper connections between words and sentences.
You can try training a really small model and seeing the gibberish outputs when you train it on only a small dataset.
Minmaxing the dataset to extract maximum generation with minimal data does sound like fun, but if you want to build SoTA models as a company, the economic tradeoff of doing that vs slapping a few more GPU's together is terrible.
How would you best utilize a model like this for coding? I take it it's not meant for vibe coding a full app, and the reasoning probably makes it unsuitable for autocomplete. Would you use it to implement specific functions? I looked at one of the coding benchmarks used, Live Code Bench, and it seems to be problem descriptions with sample input and output, and then a solution with a single function or class. Seems li…
Earlier quoted context omitted.
Try 27b, it's significantly smarter than 35b-a3b (although it is slower, it's not so bad with MTP).
At least according to gertlabs, Qwen3.6 27B outperforms every SoTA (closed) model at Kotlin: https://archive.vn/RYBCL / https://gertlabs.com/rankings?mode=agentic_coding&language=k...
Looks like we are seeing small but mighty model breakthroughs, outpacing the pure capital firepower of SOTA providers. I love rooting for the little guy, but is it too soon to call it? To play devils advocate, could it just be the benchmarks are not efficient enough to capture success of real developer workflows?
It feels sometimes like optimizations are only starting.
Am I right in thinking this is a tiny model which has been trained well to reason, and that's it? Makes me think of a smart person who doesn't know anything about a given topic, but with the right tools will go and research the heck out of it. I really like the sound of this... why have models train on learning anything when you can just train them how to learn and let them get on with it from something as small as a…
I think you could probably train a model to consider boolean logic, modal logic, and mathematics reasonably well, but there is still a pretty big leap between that and thinking about things. Even the most basic questions such as put a ball in a cup and place it on a table upside down then pick up the cup and put it in a box. Requires knowledge of things not mentioned in the question (notably gravity). Strict definiti…
That reminds me - this used to be my go-to question for smaller models and on which they would always fail miserably on:
A small strawberry is placed in a large cup. The cup is placed upside down on the kitchen table. Someone then lifts the cup as-is and puts it in the microwave. Where is the strawberry when the cup is in the microwave?
Here's what the 1.9GB VibeThinker-3B-GGUF:Q4_K_M answered:
Answer: The strawberry is still on the kitchen table – it fell out when the cup was turned upside‑down, and the subsequent lift‑and‑microwave move doesn’t change that.
So it seems there is definite progress here. Both specialized and yet improved common sense on things outside its domain of specialization.
Earlier quoted context omitted.
Model can use tools to get that knowledge. In your example, read Wikipedia page about table tennis. Imagine a reasoning engine with a big enough context, that knows nothing. A path built from first principles to understand "table tennis spin" — does not look very long for me.
How would it know about Wikipedia and when to use it? From the tool description? If we had 100k such tools, then that wouldn't even fit in the context. This is only one example, plus if the topic is more complex, maybe it had to search/learn everything (what is table tennis, what is spin, what is a human, what is a ball), etc. So it would be like spawning a baby human, have it spend an (instant) life learning about t…
I think grounding your abstract problem to an example makes it more trivial, than it sounds in general.
> How would it know about Wikipedia and when to use it?
2 general concepts "You have to get good understanding of subject area before you do actions" + "Wikipedia is a good source of knowledge of subject areas" will get a model there.
> spawning a baby human, have it spend an (instant) life learning
Humans spend 99% of their life on boring repeating tasks, not learning anything, just navigating on heuristics.