Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Qwen3.6-35B-A3B: Agentic coding power, now open to all

qwen.ai

Post reply on HN
Print view View original

241–250 of 563 posts

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#241

Post by perbu »

zkmon wrote: post #113
armanj wrote: post #20

I recall a Qwen exec posted a public poll on Twitter, asking which model from Qwen3.6 you want to see open-sourced; and the 27b variant was by far the most popular choice. Not sure why they ignored it lol.

I'm guessing 3.5-27b would beat 3.6-35b. MoE is a bad idea. Because for the same VRAM 27b would leave a lot more room, and the quality of work directly depends on context size, not just the "B" number.

MoE is excellent for the unified memory inference hardware like DGX Sparc, Apple Studio, etc. Large memory size means you can have quite a few B's and the smaller experts keeps those tokens flowing fast.

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#242

Post by mudkipdev »

storus wrote: post #235
adrian_b wrote: post #27

Earlier quoted context omitted.

Their previous model Qwen3.5 was available in many sizes, from very small sizes intended for smartphones, to medium sizes like 27B and big sizes like 122B and 397B. This model is the first that is provided with open weights from their newer family of models Qwen3.6. Judging from its medium size, Qwen/Qwen3.6-35B-A3B is intended as a superior replacement of Qwen/Qwen3.5-27B. It remains to be seen whether they will als…

> Qwen/Qwen3.6-35B-A3B is intended as a superior replacement of Qwen/Qwen3.5-27B Not at all, Qwen3.5-27B was much better than Qwen3.5-35B-A3B (dense vs MoE).

Re-read that

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#243

Post by danielhanchen »

evilduck wrote: post #232
danielhanchen wrote: post #198

Earlier quoted context omitted.

We re-uploaded Gemma4 4 times - 3 times were due to 20 llama.cpp bug fixes, which we helped solve some as well. The 4th is an official Gemma chat template improvement from Google themselves, so these are out of our hands. All providers had to re-fix their uploads, so not just us. For MiniMax 2.7 - there were NaNs, but it wasn't just ours - all quant providers had it - we identified 38% of bartowski's had NaNs. Ours w…

I just wanted to express gratitude to you guys, you do great work. However, it is a little annoying to have to redownload big models though and keeping up with the AI news and community sentiment is a full time job. I wish there was some mechanism somewhere (on your site or Huggingface or something) for displaying feedback or confidence in a model being "ready for general use" before kicking off 100+ GB model downloa…

Hey thanks - yes agreed - for now we do:

1. Split metadata into shard 0 for huge models so 10B is for chat template fixes - however sometimes fixes cause a recalculation of the imatrix, which means all quants have to be re-made

2. Add HF discussion posts on each model talking about what changed, and on our Reddit and Twitter

3. Hugging Face XET now has de-duplication downloading of shards, so generally redownloading 100GB models again should be much faster - it chunks 100GB into small chunks and hashes them, and only downloads the shards which have changed

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#244

Post by danielhanchen »

sowbug wrote: post #212
danielhanchen wrote: post #209

Earlier quoted context omitted.

Yep we can do that probs add a table - in general be post in discussions of model pages - for eg https://huggingface.co/unsloth/MiniMax-M2.7-GGUF/discussions... HF also provides SHA256 for eg https://huggingface.co/unsloth/MiniMax-M2.7-GGUF/blob/main/U... is 92986e39a0c0b5f12c2c9b6a811dad59e3317caaf1b7ad5c7f0d7d12abc4a6e8 But agreed it's probs better to place them in a table

Thanks! I know about HF's chunk checksums, but HF doesn't publish (or possibly even know) the merged checksums.

Oh for multi files? Hmm ok let me check that out

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#245

Post by fuddle »

Aurornis wrote: post #176
homebrewer wrote: post #18

Already quantized/converted into a sane format by Unsloth: https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF

Unsloth is great for uploading quants quickly to experiment with, but everyone should know that they almost always revise their quants after testing. If you download the release day quants with a tool that doesn’t automatically check HF for new versions you should check back again in a week to look for updated versions. Some times the launch day quantizations have major problems which leads to early adopters dismissi…

I don't understand why the open source model providers don't also publish the quantized version?

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#247

Post by danielhanchen »

dist-epoch wrote: post #216
danielhanchen wrote: post #198

Earlier quoted context omitted.

We re-uploaded Gemma4 4 times - 3 times were due to 20 llama.cpp bug fixes, which we helped solve some as well. The 4th is an official Gemma chat template improvement from Google themselves, so these are out of our hands. All providers had to re-fix their uploads, so not just us. For MiniMax 2.7 - there were NaNs, but it wasn't just ours - all quant providers had it - we identified 38% of bartowski's had NaNs. Ours w…

What do you think about creating a tool which can just patch the template embedded in the .gguf file instead of forcing a re-download? The whole file hash can be checked afterwards.

Sadly it's not always chat template fixes :( But yes we now split the first shard as pure metadata (10MB) for huge models - these include the chat template etc - so you only need to download that.

For serious fixes, sadly we have to re-compute imatrix since the activation patterns have changed - this sadly makes the entire quant change a lot, hence you have to re-download :(

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#248

Post by danielhanchen »

fuddle wrote: post #245
Aurornis wrote: post #176

Earlier quoted context omitted.

Unsloth is great for uploading quants quickly to experiment with, but everyone should know that they almost always revise their quants after testing. If you download the release day quants with a tool that doesn’t automatically check HF for new versions you should check back again in a week to look for updated versions. Some times the launch day quantizations have major problems which leads to early adopters dismissi…

I don't understand why the open source model providers don't also publish the quantized version?

They sometimes do! Qwen, Google etc do them!

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#249

Post by kaliqt »

znnajdla wrote: post #196
aliljet wrote: post #73

I'm broadly curious how people are using these local models. Literally, how are they attaching harnesses to this and finding more value than just renting tokens from Anthropic of OpenAI?

Some tasks don’t require SOTA models. For translating small texts I use Gemma 4 on my iPhone because it’s faster and better than Apple Translate or Google Translate and works offline. Also if you can break down certain tasks like JSON healing into small focused coding tasks then local models are useful

Is it really better? In which languages?

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#250

Post by kylehotchkiss »

aliljet wrote: post #73

I'm broadly curious how people are using these local models. Literally, how are they attaching harnesses to this and finding more value than just renting tokens from Anthropic of OpenAI?

I am working on a research project to link churches from their IRS Exempt org BMF entry to their google search result from 10 fetched. Gwen2.5-14b on a 16gb Mac Mini. It works good enough!

It's entertaining to see HN increasingly consider coding harness as the only value a model can provide.

Post reply on HN