[deleted]
Qwen3.6-35B-A3B: Agentic coding power, now open to all
61–70 of 563 posts
Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all
#62I recall a Qwen exec posted a public poll on Twitter, asking which model from Qwen3.6 you want to see open-sourced; and the 27b variant was by far the most popular choice. Not sure why they ignored it lol.
The 27B model is dense. Releasing a dense model first would be terrible marketing, whereas 35A3B is a lot smarter and more quick-witted by comparison!
Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all
#63What do all the numbers 6-35B-A3B mean?
[deleted]
Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all
#64Earlier quoted context omitted.
It's a MoE model and the A3B stands for 3 Billion active parameters, like the recent Gemma 4. You can try to offload the experts on CPU with llama.cpp (--cpu-moe) and that should give you quite the extra context space, at a lower token generation speed.
Mac has unified memory, so 36GB is 36GB for everything- gpu,cpu.
CPU-MoE still helps with mmap. Should not overly hurt token-gen speed on the Mac since the CPU has access to most (though not all) of the unified memory bandwidth, which is the bottleneck.
Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all
#65Earlier quoted context omitted.
i dont get it, mac has unified memory how would offloading experts to cpu help?
I bet the poster just didn’t remember that important detail about Macs, it is kind of unusual from a normal computer point of view. I wonder though, do Macs have swap, coupled unused experts be offloaded to swap?
Of course the swap is there for fallback but I hate using it lol as I don't want to degrade SSD longevity.
Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all
#66Earlier quoted context omitted.
It's a MoE model and the A3B stands for 3 Billion active parameters, like the recent Gemma 4. You can try to offload the experts on CPU with llama.cpp (--cpu-moe) and that should give you quite the extra context space, at a lower token generation speed.
Do I expect the same memory footprint from an N active parameters as from simply N total parameters?
[deleted]
Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all
#67Already quantized/converted into a sane format by Unsloth: https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF
How much VRAM does it need? I haven't run a local model yet, but I did recently pick up a 16GB GPU, before they were discontinued.
Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all
#68Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all
#69A relief to see the Qwen team still publishing open weights, after the kneecapping [1] and departures of Junyang Lin and others [2]! [1] https://news.ycombinator.com/item?id=47246746 [2] https://news.ycombinator.com/item?id=47249343
This is just one model in the Qwen 3.6 series. They will most likely release the other small sizes (not much sense in keeping them proprietary) and perhaps their 122A10B size also, but the flagship 397A17B size seems to have been excluded.
397A17B = 397B total weights, 17B per expert?
Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all
#70What do all the numbers 6-35B-A3B mean?
35B (35 billion) is the number of parameters this model has. Its a Mixture of Experts model (MoE) so A3B means that 3B parameters are Active at any moment.