Qwen 3.8 27B

Post by z4y5f3 » Sat, Aug 15, 2026, 4:50 AM UTC

suprjami wrote: post #556

skrebbel wrote: post #178

Earlier quoted context omitted.

I'd love to understand this more. Are you saying the Qwen team spends their very impressive human and compute resources on publishing these amazing models and then botches the chat template with mundane bugs? Like maybe I just misunderstand what's the hard part but wouldn't you assume that people who can put together an impressive model can also write a proper jinja chat template for it?

You have understood correctly. One really would think these companies (including Google) who spend many millions of dollars on compute could write a few hundred lines of Jinja correctly, so their investment works optimally or at all. But they don't. Then a couple of individuals on HuggingFace fix it, either a 2-person startup like Unsloth or a volunteer like froggeric. I also don't understand how this repeatedly happ…

Post by literoldolphin » Sat, Aug 15, 2026, 5:14 AM UTC

bigyabai wrote: post #545

literoldolphin wrote: post #289

Earlier quoted context omitted.

And yet it's also a laptop you can basically take anywhere unlike a giant video card with 1000 watt power supply requirements.

Nvidia and AMD both have their own unified memory laptop SOCs, now. Apple Silicon's GPU is relatively weak, it's one of the less-efficient ways to use 100w for compute. Even the fastest Apple Silicon chips like the M5 Max and the M3 Ultra still put up worse GPU compute performance than last-gen laptop RTX 4080 chips. And they don't scale, the largest M3 Ultra cluster you can configure is still ~2,000x smaller than a…

Post by SwellJoe » Sat, Aug 15, 2026, 5:30 AM UTC

nullc wrote: post #665

SwellJoe wrote: post #377

Earlier quoted context omitted.

AgentWorld is a pretty recent MoE release from the Qwen folks with quite a bit better performance than 3.6, released around the same time as 3.7 Plus/Max, I guess. Not sure why it didn't get more attention, as it is definitely better than 3.6 35B A3B on all dimensions, but especially for agentic use. Still nowhere near the dense models (even 3.6 27B), but clearly an upgrade in the small Qwen MoE line. https://hugging…

HUH? AgentWorld is a simulation of the world (e.g. tools and programs) for use by an agent!

Post by DanielHB » Sat, Aug 15, 2026, 5:32 AM UTC

Wowfunhappy wrote: post #572

redox99 wrote: post #164

Earlier quoted context omitted.

Asking it factual information[1]. You just can't compress the entire human knowledge into a 30GB file. [1] Without searching the internet. And even if you allow it, you'll get much worse results because search means browsing and parsing the top results, and search results are horrible, whereas internal knowledge from training encompasses the entire internet plus all books including very niche stuff.

> You just can't compress the entire human knowledge into a 30GB file. ...I'm just asking questions here... how sure are we of this? If you'd asked me six years ago whether we could compress all of human knowledge into a 1 TB file, I would have said no, and yet here we are. If you can do 1 TB, why not 30 GB? It's, like, within one order of magnitude.

Post by akoboldfrying » Sat, Aug 15, 2026, 5:44 AM UTC

CMay wrote: post #657

urbnspacecowboy wrote: post #627

Earlier quoted context omitted.

> Qwen 3.8 27B is only the second local model after Gemma 4 that managed to correctly reason through one of my private benchmarks. I don't expect you to blab publicly about your private benchmark, but what sorts of reasoning does it require?

Well, I will say: #1: it does not require deep world knowledge, because that's not what local models are for. #2: it directly attacks drive-by understanding, overly linear processing training, poor attention mechanisms, poor reasoning patterns or lazy assumptions that ignore very easy low hanging fruit. #3: it requires solid instruction following in the face of errors. a lot of models will run into errors and then fa…