Hmm. No MoE or active params weights means this will run _slow_
Qwen 3.8 27B
331–340 of 848 posts
Re: Qwen 3.8 27B
#332Earlier quoted context omitted.
[flagged]
Yeah I'm sure everyone on r/cursor or in previous HN threads about Grok 4.5 or 4.6 are all unserious and insane. No one actually cares about the politics as long as the model codes well. Edit, quite interesting to see the reception to this comment compared to essentially the same type of comment I made on a Grok 4.6 benchmark HN post: https://news.ycombinator.com/item?id=49275385#49275571 It's true that Cursor gives…
[flagged]
Re: Qwen 3.8 27B
#333Will there be an A4B MoE?
Re: Qwen 3.8 27B
#334Apart from model performance, what harness are people using to come close to Claude Code or Codex workflow styles with tool use, conversations, loops, remote control, etc.?
Re: Qwen 3.8 27B
#335Earlier quoted context omitted.
Lol at that command. Why is this stuff so hard to run locally? I've spent a few days trying to figure it all out and haven't been able to. LM Studio doesn't work behind proxies. Ollama is confusing and doesn't seem to support Qwen3? And Llama.cpp is your command. I just want to run ` ` with some default parameters set and for it to run locally.
I never install this stuff manually anymore. Just tell your LLM of choice to download model X from URL Y, build the latest inference engine of choice E, and then create batch files or shell scripts to run instruct and/or reasoning models in accordance with instructions at URL Z.
[deleted]
Re: Qwen 3.8 27B
#336Beats Opus 4.7 Max (w/ Claude Code) on DeepSWE (42.2 vs 40). Looks like Qwen's 27B models continue to pack some punch. Unsloth's GGUF quants are up: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF
Oh, goody goody goody! Can't wait for a Q4M with *MTP* support. Does anyone know if there are plans for it? I am currently using Qwen 3.6 on RTX 3090 and I have to admit that without MTP it would be too slow to be acceptable for me (30-35 tok/sec without MTP, 60-70 with MTP). Without MTP I would just use OpenRouter and rather pay for speed despite having a capable local setup.
It comes with MTP already, they just don't mention it in the filename as it's now the default.
Re: Qwen 3.8 27B
#337"Generate an SVG of a pelican riding a bicycle" - generated a promising image at first shot.
Re: Qwen 3.8 27B
#338WOW, my first try running on my 2 3090's, it was a bit slow... but it FEELS like opus 4.5, i gave it an image and a broad overview of what I wanted it to build, and it built the whole thing from beginning to end.
Re: Qwen 3.8 27B
#339Earlier quoted context omitted.
Same, I have one workload where on 3.6 drafting 6 tokens is the fastest setting.
I wonder if we could take a page out of the Solar power book and do MPPT but for draft count. Constantly sweep through possible values to find the best result for the current conditions. Though it might turn out that that doesn't offer any benefits. Has it been tried yet? ___ EDIT: LLM pointed me towards this thing I'm not going to read https://arxiv.org/abs/2512.11280 "AdaSD: Adaptive Speculative Decoding for Effici…
Deepseek's DSpark does dynamically adjust speculated token count per user/completion.
https://arxiv.org/abs/2607.05147
But they do so to maximise total throughput, I don't think there's reason to do that for batch=1.
Re: Qwen 3.8 27B
#340Since it might be helpful to some, here's my current commandline for llama.cpp running on an RTX 4090 with my monitor moved to the iGPU to free up all of its VRAM. llama-server -m Qwen3.8-27B-IQ4_NL.gguf --mmproj mmproj-BF16.gguf -c 170000 --parallel 1 -ngl -1 --cache-type-k q8_0 --cache-type-v q8_0 -b 1024 -ub 512 --flash-attn on --no-context-shift --no-mmproj-offload --spec-type draft-mtp --spec-draft-n-max 5 --spe…
I absolutely love this comment. I wished there was a website where people would post their working command lines as well as what hardware they are using to run that stuff on + tokens / sec prefill + gen.