Qwen3.6-35B-A3B: Agentic coding power, now open to all • Hacker News Board

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#561

Post by bigiain » Sun, Apr 19, 2026, 11:52 PM UTC

mananaysiempre wrote: post #552

bigiain wrote: post #419

Earlier quoted context omitted.

> I work 128GB M4 but not run inference, just too many electron apps running at the same time. This is somewhat depressing - needing a couple of thousand bucks worth of ram just to run your chat app and code/text editor and API doco tool and forum app and notetaking app all at the same time...

Crucial (Micron) sold 128GB of DDR5-5600 in SODIMM form for $280 a year ago. It would be slower tham the same amount on an M4 Mac, but still, I object to characterizing either as “a couple thousand bucks worth”.

I( get that number by optioning up a Mac Studio to 128GB at the Apple Store.

(Admittedly, Apple should be facing criminal price gouging law suits for their ram pricing.)

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#562

Post by 3836293648 » Tue, Apr 21, 2026, 10:40 AM UTC

nxtfari wrote: post #528

3836293648 wrote: post #374

Qwen3.6 and Gemma4 have the same issue of never getting to the point and just getting stuck in never ending repeating thought loops. Qwen3.5 is still the best local model that works.

I had issues with Qwen thinking endlessly when I didn’t know I wasn’t using the temp/top_k/min_p/etc settings specified in the readme. I’ve never had an issue with Gemma 4 thinking endlessly but could possibly be the same.

I use Ollama and kinda just assumed that Ollama would have everything except for context length (which I've explicitly overwritten) setup properly for me.

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#563

Post by mjsabby » Thu, Apr 23, 2026, 4:52 AM UTC

jchw wrote: post #195

zozbot234 wrote: post #149

Earlier quoted context omitted.

New versions of llama.cpp have experimental split-tensor parallelism, but it really only helps with slow compute and a very fast interconnect, which doesn't describe many consumer-grade systems. For most users, pipeline parallelism will be their best bet for making use of multi-GPU setups.

Yeah, I was doing split tensor and it seemed like a wash. The Arc B70s are not huge on compute. Right now I'm only able to run them in PCI-e 5.0 x8 which might not be sufficient. But, a cheap older Xeon or TR seems silly since PCI-e 4.0 x16 isn't theoretically more bandwidth than PCI-e 5.0 x8. So it seems like if that is really still bottlenecked, I'll just have to bite the bullet and set up a modern HEDT build. With…

I've joined the B70 bandwagon as well, and have started profiling, will keep this thread updated. I suspect if we get enough of us to get even 80% of theoretical perf we'll be in a good spot. I also have two B70s.