Live data from Hacker News

Qwen 3.8 27B

huggingface.co

711–720 of 848 posts

Re: Qwen 3.8 27B

#711
post #518

Credit where it's due. Qwen 3.8 27B is only the second local model after Gemma 4 that managed to correctly reason through one of my private benchmarks. It took 5x as many tokens to do it and 12m30s with MTP enabled, but it did do it. Gemma 4 reasoned through it more implicitly, while Qwen 3.8 reasoned more explicitly. Laguna and Muse Glimmer failed hard on it, though they're useful for other tasks. The VRAM usage see…

Qwen’s 3.6/3.8 27b actually has some algorithmic advantage when it comes to the kv cache size needed, so it actually needs less memory at equivalent context. My experience using both in vllm supports, with considerably more overhead in context size on these models than Gemma 4 31b, and better performance in most tasks I’ve tried on both models.

Qwen 3.x does have an advantage but it's relatively small (64KB/token vs 80KB/token) - Gemma4 actually has less % of full attention layers, but the largest geometry and has the biggest "fixed" state for it's non-global layers. Muse Glimmer actually has by far the lowest per-token cache usage for the competitive 30B-class dense models - it's at about 13KB/token - very aggressive GQA (32Q/2KV) and also by far the smallest QKV dimensions.

Actually perf (speed) is going to mostly on token output, and here Qwen 3.x historically tends to lose badly as it tends to overthink a lot. I'll be running evals on 3.8 myself this weekend to see how its reasoning levels perform.

I assume that AA will have 3.8 numbers soon and Intelligence Index vs Output Tokesn per Intelligence Index Task is a decent way to view that: https://artificialanalysis.ai/models/muse-glimmer?intelligen...

Re: Qwen 3.8 27B

#712
www.asuralist.in

Couldn’t afford claude pro so I built an web based DSA coach that coaches you on DSA and System design in a socratic way. It uses a qwen 1.5B coder model and inferencing is all done on a CPU. ( who needs a GPU anyway )

Re: Qwen 3.8 27B

#713

Earlier quoted context omitted.

I've been getting ads in my Instagram for http://colorcase.com . They add colors and wheels to cases and I'm sharing them because you're right, most of them aren't orange. But they could be!

Wow, those are expensive. I've been buying pelican 1510 and similar from eBay and b&h used/refurb. The harbor freight pelican knock off that is their 3800 and 4800 product numbers are also not bad. It's like 85% as good as a real pelican for 40% of the price.

it's just money and you wanna look good. You're worth it.

Re: Qwen 3.8 27B

#714

Tested the model briefly with my usual eval: a couple of questions on general knowledge most small models often get wrong, then write a fully-featured todo list app in JS, then rewrite the same app in Rust with Tauri. Granted, most models are well trained on basic todo apps, but it gives me an idea of the basic SWE capabilities I can build on. As far as I'm concerned, if it can successfully setup a local git repo, wr…

> General knowledge: I usually ask 2 questions many small models get wrong: summarize Operation Trojan Horse by John Keel, give publication year. Summarize the Ariel school incident of 1994. Qwen3.8 got the first question right, along correct publication year, gave glorious detail on Keel's theory, but got the second wrong. It thought that school was located in the USA. Ah well.

I'm not sure that this means anything. You're asking a ~27GB file to have losslessly compressed the entire training set (which apparently is a large chunk of the entire internet). That's not possible. Whether it happened to encode these particularly obscure facts losslessly or vaguely isn't really telling you anything about how good a model it is.

Re: Qwen 3.8 27B

#715

Earlier quoted context omitted.

> Qwen 3.8 27B is only the second local model after Gemma 4 that managed to correctly reason through one of my private benchmarks. I don't expect you to blab publicly about your private benchmark, but what sorts of reasoning does it require?

It writes turing complete Beauty and the Beast fanfic.

:D, just upvoting this in case of someone downvotes

Re: Qwen 3.8 27B

#716
post #495
post #415

Earlier quoted context omitted.

what token/s?

27 t/s. I suspect there will be significant speed ups in the coming weeks.

Getting 30 t/s on a Mac M5 Max laptop. You should be getting close to 200 if you can use the 5090 acceleration tools I see posted here. There are forks for the 4090 and the 3090. Maybe there's a fork for the 6000?

Re: Qwen 3.8 27B

#717

Tested the model briefly with my usual eval: a couple of questions on general knowledge most small models often get wrong, then write a fully-featured todo list app in JS, then rewrite the same app in Rust with Tauri. Granted, most models are well trained on basic todo apps, but it gives me an idea of the basic SWE capabilities I can build on. As far as I'm concerned, if it can successfully setup a local git repo, wr…

> General knowledge: I usually ask 2 questions many small models get wrong: summarize Operation Trojan Horse by John Keel, give publication year. Summarize the Ariel school incident of 1994. Qwen3.8 got the first question right, along correct publication year, gave glorious detail on Keel's theory, but got the second wrong. It thought that school was located in the USA. Ah well. I'm not sure that this means anything.…

I concur, treating models as question and answer machines and judging them on recall is meaningless, unless you're measuring quantisation impact on a foundation model maybe.

Re: Qwen 3.8 27B

#718
post #417

There's a real change (compared to 3.6) in the way it writes in thinking — it drops words like "to" and "we" in "We need to", talks generally in note form, drops the/and all over the place, avoids "for". "Need be helpful concise", "Need maybe not overdo", "Need ask!" Almost caveman. I have an (unsourced, vague) suspicion that this rather unique thinking trace pattern is actually hobbling the MTP predictions, which se…

This is pretty much Chinese grammar with English words. In Chinese you'd say "need ask" or "I need ask" if you want to be unusually verbose, but there's no "to".

All your examples align with this too. It just sounds to me like its optimising by removing the superfluous English words and thinking more Chinesely.

Re: Qwen 3.8 27B

#719

Earlier quoted context omitted.

Promise I'm not being flippant or rude, but why not ask it to write something like a parameterized script to do the same thing for you ?

Laziness, primarily. Plus, no two models are exactly alike, and some have different instructions in their model card or on the HF page.

[deleted]

Re: Qwen 3.8 27B

#720

Earlier quoted context omitted.

Promise I'm not being flippant or rude, but why not ask it to write something like a parameterized script to do the same thing for you ?

Laziness, primarily. Plus, no two models are exactly alike, and some have different instructions in their model card or on the HF page.

[deleted]
Post reply on HN