They've also announced Qwen3.8-27B being released open-weight next week. Qwen3.6-27B is widely regarded as one of the best local models, especially since nothing else comes close to it, that isn't benchmaxxed, without being significantly larger. If 3.8 truly improves upon it that would be awesome.
Qwen3.6-35B is my daily driver for AI, and what convinced me to cancel my Claude subscription back in April. The Qwen3.6 line is easily the best local model I've tried, and I've tried a lot. I've got it diligently grinding away on my laptop right now, reviewing and fixing some bugs in my F# code.
Qwen3.8-Max: A New Bar for Coding and Cowork
301–310 of 653 posts
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#302Earlier quoted context omitted.
A local model needs 0 investment and 0 commitment, takes literal minutes to get started (especially if you have someone who is into that stuff showing you the ropes) and if you end up disliking the experience of using AI you can just `rm -fr` it and forget the whole thing existed.
Needs 0 investment and 0 committment? - You at least need a capable machine, so that's not 0 monetary investment. - You need to spend at least an hour decicding between ollama, llamacp, mlx, etc. - You need to find the correct quantized version of the model that works for you based on the architecture. - You need to figure out the correct context window size to get reasonable performance. - You need to setup a harnes…
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#303This makes me wonder if AI companies even have a MOAT in the first place. All requests to an LLM are idempotent, for every API call you need to send it the entire conversation history so that it can process it. LLMs do not learn or remember anything, which makes it super easy for users to switch LLMs on the fly. Most popular AI frameworks, make this a one-liner change these days. And that makes me wonder if the trill…
With their current API approach they're essentially a commodity. They need to start moving parts of the harness behind the API, otherwise they'll remain a commodity. Recursive self-improvement changes the parameters a bit, especially for the market-leaders, and it's the one thing that makes me wonder if they'll be able to extend their lead faster than the smaller labs can keep up, but it's an option available to ever…
This isn't without it's challenges however.
1. This will increase costs drastically, since they would need to a run a sandbox per use to ensure data isolation.
2. Increased latency, and this directly limits how much of the harness can be moved to the cloud before the users notice sluggishness
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#304They've also announced Qwen3.8-27B being released open-weight next week. Qwen3.6-27B is widely regarded as one of the best local models, especially since nothing else comes close to it, that isn't benchmaxxed, without being significantly larger. If 3.8 truly improves upon it that would be awesome.
Qwen 3.6 27b has been the sweet spot for me in terms of local models. I've had good luck using it with Pi harness. Looking forward to this.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#305This makes me wonder if AI companies even have a MOAT in the first place. All requests to an LLM are idempotent, for every API call you need to send it the entire conversation history so that it can process it. LLMs do not learn or remember anything, which makes it super easy for users to switch LLMs on the fly. Most popular AI frameworks, make this a one-liner change these days. And that makes me wonder if the trill…
A more appropriate term is “stateless”. LLM responses are certainly not idempotent, as they are not even deterministic.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#306Earlier quoted context omitted.
Qwen3.6-35B is my daily driver for AI, and what convinced me to cancel my Claude subscription back in April. The Qwen3.6 line is easily the best local model I've tried, and I've tried a lot. I've got it diligently grinding away on my laptop right now, reviewing and fixing some bugs in my F# code.
I'm a big ole noob when it comes to local AI. What are you using for a harness? Or platform to interact with it?
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#307Earlier quoted context omitted.
A local model needs 0 investment and 0 commitment, takes literal minutes to get started (especially if you have someone who is into that stuff showing you the ropes) and if you end up disliking the experience of using AI you can just `rm -fr` it and forget the whole thing existed.
Needs 0 investment and 0 committment? - You at least need a capable machine, so that's not 0 monetary investment. - You need to spend at least an hour decicding between ollama, llamacp, mlx, etc. - You need to find the correct quantized version of the model that works for you based on the architecture. - You need to figure out the correct context window size to get reasonable performance. - You need to setup a harnes…
Pi has a nice guide on it (https://pi.dev/docs/latest/llama-cpp) and it is really not that hard.
How is that hypocrisy? Self hosting is somehow anti AI? Its not anti AI. Its literally using AI!
…and honestly, at a higher technical level than slapping your wallet against a token provider and running prompts in a hosted sandbox you can't even see the prompts in.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#308This makes me wonder if AI companies even have a MOAT in the first place. All requests to an LLM are idempotent, for every API call you need to send it the entire conversation history so that it can process it. LLMs do not learn or remember anything, which makes it super easy for users to switch LLMs on the fly. Most popular AI frameworks, make this a one-liner change these days. And that makes me wonder if the trill…
They don't. The moat will mainly be the tooling around AI, not the AI itself. You don't hear any company claiming their moat is the Internet.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#309Earlier quoted context omitted.
First and foremost, China isn't energy-limited like the US is. A modern grid, lost of cheap power coming online every day. The worlds most advance ultra-high voltage transport links are tying the deserts in the west to the cities in the south. It probably sucks for you if the proposed powerline goes through your house, but the need of the many come first. Having cheap and plentiful power is a huge market advantage. I…
I think this is really a rosy image of China’s electrify situation. They have huge needs in the east and green energy in the west, they can’t build their UHV links fast enough. They are doing ok at keeping up, but there isn’t a surplus of cheap electricity lying around in the same places where you have cheap water as well.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#310Earlier quoted context omitted.
It was for me too but the new deepseek pricing is too good to ignore for now. I honestly think that with my electricity prices running qwen 36B myself is more expensive than hitting the cache rate at deepseek.
Can you elaborate on DeepSeek (deepseek-v4-flash, i assume?). What does your typical usage pattern look like and what is your weekly/monthly spend? I gave it a try for a few days (pi + openrouter + deepseek-v4-flash via deepinfra) and ended up paying ~$18 for rather light usage. Yes it's still cheap, yes it's fast, but i feel i would still get a better deal with a Claude subscription plan.