Live data from Hacker News

Qwen3.8-Max: A New Bar for Coding and Cowork

qwen.ai

431–440 of 652 posts

Re: Qwen3.8-Max: A New Bar for Coding and Cowork

#431

They've also announced Qwen3.8-27B being released open-weight next week. Qwen3.6-27B is widely regarded as one of the best local models, especially since nothing else comes close to it, that isn't benchmaxxed, without being significantly larger. If 3.8 truly improves upon it that would be awesome.

There was an interesting interview by MLST with a team doing well on ARC AGI 3 who are using Qwen 3.6 27B, and said that it's actually better at coding than the larger 3.6 35B. I guess which of the smaller 3.8 models is best for coding will depend on which one they put the training effort into.

I have found 27 to just be so much more coherent than 35:

https://humanparadox.org/local-vs-frontier-benchmarks-for-my...

It can complete multi-step tasks much better, and has a bit more curiosity.

Re: Qwen3.8-Max: A New Bar for Coding and Cowork

#432

Earlier quoted context omitted.

I've heard 27B is smarter! I tried it some time ago but couldn't get it working with my oMLX. I need to try it again.

In my case I would say they are comparable but moe models are looping and getting lost a lot more than dense models. On the other hand having 90t/s with any local model is nice and Pi with loop police extension can prevent looping a lot.

Looping seems related to quantization and not the model itself. If youre digging deep into quants to get working context then yeah.

Re: Qwen3.8-Max: A New Bar for Coding and Cowork

#433
post #390
post #375

Earlier quoted context omitted.

They can be deterministic. We did this at Groq, if you sent a request with exactly the same input token, seed and temperature value you would get precisely the same result every time. This is harder to do on other architectures that themselves aren't fully deterministic though.

Was the temperature 0? Cause unless I don't understand it right, any non-zero temperature implies probabilistic next token prediction. You did mention, seed, which I haven't seen available anywhere else (in my limited experience) and it can explain a reproducible inference result, but I feel like this matches the "letter of the law" meaning of deterministic rather than the "spirit of the law".

Perhaps they just used the exact same random seed everywhere?

Re: Qwen3.8-Max: A New Bar for Coding and Cowork

#434

This makes me wonder if AI companies even have a MOAT in the first place. All requests to an LLM are idempotent, for every API call you need to send it the entire conversation history so that it can process it. LLMs do not learn or remember anything, which makes it super easy for users to switch LLMs on the fly. Most popular AI frameworks, make this a one-liner change these days. And that makes me wonder if the trill…

The moat is the US government.

Re: Qwen3.8-Max: A New Bar for Coding and Cowork

#435
post #79

I'm trying and failing to find value running a potential Qwen 3.8 27b dense model on a 16 core, 128 GB of ram, 2080ti box. Yes, the GPU yells for help, but the problem is that no math works to upgrade this machine even when pouring $200 in rent every month into the large model providers... How are you all justifying economical use of these local models right now? What's the cost efficient way to do this and do better…

I use opencode go and pay 10$ a month. Works good for me.

Re: Qwen3.8-Max: A New Bar for Coding and Cowork

#437

Earlier quoted context omitted.

Qwen-3.6-35B-A3B was our "gateway drug" into switching our organisation to agent/harness-first coding. Particularly, I had one team member who was extremely sceptical of AIs/LLMs/harnesses and refused to use them. One day he said "Well, I have an RTX 5090 doing nothing... should I try to get something up on it?" and a few minutes later he had 3.6-35B loaded up, running OpenCode. It continues to be a workhorse to this…

I’ve run 3.6-27B and 3.6-35B on 32GB locally for a lot of bulk non-code tasks. Let it run overnight and wake up to millions of output tokens worth of results without data having left my house, all for the price of electricity. I haven’t found it very useful for code. It can do some code, but I’ve tried a dozen different quants and context lengths and the output is always bad enough that it has to be discarded for any…

> I’ve run 3.6-27B and 3.6-35B on 32GB locally for a lot of bulk non-code tasks.

Do you mind sharing your use cases?

Re: Qwen3.8-Max: A New Bar for Coding and Cowork

#438

Earlier quoted context omitted.

This is what I've been waiting for. We are still using fine-tuned deployments of Qwen3.6-27B with a lot of success but could use a bump in intelligence. Here's hoping.

How and where do you finetune it?

I use Modal for fine tuning and unsloth mostly.

Re: Qwen3.8-Max: A New Bar for Coding and Cowork

#439

Earlier quoted context omitted.

Google figured this out with their paper from 2023, We have no moat and neither does OpenAI . The moat now is the harness and being able to recursively self improve from RLHF, a great example is how Grok used to be pretty bad but since SpaceX bought Cursor, they used that data to train Grok 4.5 which is now very competent at coding and even exceeds frontier models in certain benchmarks. https://www.semianalysis.com/p…

And yet investment is continuing. What are they counting on?

Bubbles aren't always rational.

Re: Qwen3.8-Max: A New Bar for Coding and Cowork

#440

Earlier quoted context omitted.

Google figured this out with their paper from 2023, We have no moat and neither does OpenAI . The moat now is the harness and being able to recursively self improve from RLHF, a great example is how Grok used to be pretty bad but since SpaceX bought Cursor, they used that data to train Grok 4.5 which is now very competent at coding and even exceeds frontier models in certain benchmarks. https://www.semianalysis.com/p…

Surely the moat is the training data... with the data you can explore new architectures much easier and get step changes in performance.

The training data, at least up to now, is very abundant and basically every lab has the same data from scraping the Internet. RLHF data is what's now valuable.
Post reply on HN