Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Qwen3.6-35B-A3B: Agentic coding power, now open to all

qwen.ai

Post reply on HN
Print view View original

291–300 of 563 posts

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#291

Post by deaux »

zozbot234 wrote: post #215
deaux wrote: post #211

Earlier quoted context omitted.

While they can be run locally, and most of the discussion on HN about that, I bet that if you look at total tok/day local usage is a tiny amount compared to total cloud inference even for these models. Most people who do use them locally just do a prompt every now and then.

This is why I'd like to see a lot more focus on batched inference with lower-end hardware. If you just do a tiny amount of tok/day and can wait for the answer to be computed overnight or so, you don't really need top-of-the-line hardware even for SOTA results.

> If you just do a tiny amount of tok/day and can wait for the answer to be computed overnight or so

But they can't? The usage pattern is the polar opposite. Most people running these models locally just ask a few questions to it throughout the day. They want the answers now, or at least within a minute.

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#292

Post by danielhanchen »

CamperBob2 wrote: post #273
evilduck wrote: post #232

Earlier quoted context omitted.

I just wanted to express gratitude to you guys, you do great work. However, it is a little annoying to have to redownload big models though and keeping up with the AI news and community sentiment is a full time job. I wish there was some mechanism somewhere (on your site or Huggingface or something) for displaying feedback or confidence in a model being "ready for general use" before kicking off 100+ GB model downloa…

Best policy is to just wait a couple of weeks after a major model is released. It's frustrating to have to re-download tens or hundreds of GB every few days, but the quant producers have no choice but to release early and often if they want to maintain their reputation. Ideally the labs releasing the open models would work with Unsloth and the llama.cpp maintainers in advance to work out the bugs up front. That does…

Yep agreed at least 1 week is a good idea :)

We do get early access to nearly all models, and we do find the most pressing issues sometimes. But sadly some issues are really hard to find and diagnose :(

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#293

Post by rwmj »

kridsdale3 wrote: post #272
kylehotchkiss wrote: post #252

Earlier quoted context omitted.

How many people/hackernews can run a 397b param model at home? Probably like 20-30.

I can (barely, but sustainably) run Q3.5 397B on my Mac Studio with 256GB unified. It cost $10,000 but that's well within reach for most people who are here, I expect.

For some reason you were being downvoted but I enjoy hearing how people are running open weights models at home (NOT in the cloud), and what kind of hardware they need, even if it's out of my price range.

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#294

Post by bdangubic »

toxik wrote: post #274
kridsdale3 wrote: post #272

Earlier quoted context omitted.

I can (barely, but sustainably) run Q3.5 397B on my Mac Studio with 256GB unified. It cost $10,000 but that's well within reach for most people who are here, I expect.

$10k is well outside my budget for frivolous computer purchases.

99.97% of HN users are nodding… :)

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#295

Post by [deleted] »

lelanthran wrote: post #95
bossyTeacher wrote: post #39

Earlier quoted context omitted.

Have you tried asking about sensitive topics? I asked it if there were out of bounds topics but it never gave me a list. See its responses: Convo 1 - Q: ok tell me about taiwan - A: Oops! There was an issue connecting to Qwen3.6-Plus. Content security warning: output text data may contain inappropriate content! Convo 2 - Q: is winnie the pooh broadcasted in china? - A: Oops! There was an issue connecting to Qwen3.6-P…

> Have you tried asking about sensitive topics? Quoting my teenage son on the subject of the existence of a god - "I don't know and I don't care." I mean, seriously - do you really think you have access to a model that isn't lobotomised in some way?

[deleted]

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#297

Post by jwitthuhn »

aliljet wrote: post #73

I'm broadly curious how people are using these local models. Literally, how are they attaching harnesses to this and finding more value than just renting tokens from Anthropic of OpenAI?

I've been largely using Qwen3.5-122b at 6 bit quant locally for some c++/go/python dev lately because it is quite capable as long as I can give it pretty specific asks within the codebase and it will produce code that needs minimal massaging to fit into the project.

I do have a $20 claude sub I can fall back to for anything qwen struggles with, but with 3.5 I have been very pleased with the results.

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#298

Post by deaux »

wild_egg wrote: post #146
jake-coworker wrote: post #42

This is surprisingly close to Haiku quality, but open - and Haiku is quite a capable model (many of the Claude Code subagents use it).

Where did you see a haiku comparison? Haiku 4.5 was my daily driver for a month or so before Opus 4.5 dropped and would be unreasonably happy if a local model can give me similar capability

I find Gemma 4 26B A4B better than Haiku 4.5 and that's smaller than this one.

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#299

Post by qskousen »

danielhanchen wrote: post #151
sigbottle wrote: post #94

Earlier quoted context omitted.

That... is a more plausible explanation I didn't think of.

Yes we collab with them!

Sorry this is a bit of a tangent, but I noticed you also released UD quants of ERNIE-Image the same day it released, which as I understand requires generating a bunch of images. I've been working to do something similar with my CLI program ggufy, and was curious of you had any info you could share on the kind of compute you put into that, and if you generate full images or look at latents?

Re: Qwen3.6-35B-A3B: Agentic coding power, now open to all

#300

Post by deaux »

kaliqt wrote: post #249
znnajdla wrote: post #196

Earlier quoted context omitted.

Some tasks don’t require SOTA models. For translating small texts I use Gemma 4 on my iPhone because it’s faster and better than Apple Translate or Google Translate and works offline. Also if you can break down certain tasks like JSON healing into small focused coding tasks then local models are useful

Is it really better? In which languages?

Yes it is and has been for a very long time, it has been years now. Gemini 1.5 Pro is when LLM translations started significantly outperforming non-LLM machine translation, and that came out over 2 years ago.

Ever since then Google models have been the strongest at translation across the board, so it's no surprise Gemma 4 does well. Gemini 3 Flash is better at translation than any Claude or GPT model. OpenAI models have always been weakest at it, continuing to this day. It's quite interesting how these characteristics have stayed stable over time and many model versions.

I'm primarily talking about non-trivial language pairs, something like EnglishSpanish is so "easy" now it's hard to distinguish the strong models.

Post reply on HN