Earlier quoted context omitted.
Page won’t load for me it’s just grey bars fading back and forth forever.
You can always wait until the page loads before posting your thoughts on the Internet
Two days later page still doesn’t load.
Qwen3.8-Max: A New Bar for Coding and Cowork
491–500 of 652 posts
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#492Earlier quoted context omitted.
Can you please explain why?
Not who you responded to, but I’ll give it a try. Imagine our LLM as this one-dimensional matrix (instead of unfathomably many, many more dimensions): 0.728201017 -1.9293839303 2.93020202929 5.82290101728 -0.2844920917 … And then, all of these values are multiplied by some scaling factor, essentially vectors pointing in some direction (in our case, only on a one-dimensional line instead of in some higher-dimensional…
The exception being the token embeddings and lm head (which scale with the number of tokens the model knows and presumably you need a smaller number in the tokenizer for only English and python). But those are a pretty small % of the total model weights on most LLM sizes
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#493Earlier quoted context omitted.
> You at least need a capable machine, so that's not 0 monetary investment It is 0 monetary investment if I already have said machine lying around doing nothing. Which is exactly the story OP talked about.
But most people don't have an RTX 5090 lying around, so the story doesn't apply to them, right?
Back in “the day” nerds just bought the hardware to fuck with. Some of us still do. Claiming that compute is the barrier to entry just means you’re not a nerd. That’s ok.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#494Earlier quoted context omitted.
They are profitable and active on the enterprise local model territory. You can RL a model with them for your own purposes and I heard good things about it.
Mistral's business model works even if they start using Chinese models instead of training their own.
If China keeps releasing LLMs with such permissive licenses it probably works better since the pretraining rnd is subsidized and de-risked - but that’s a big if.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#495As someone who is searching for a new programming contract right now, reading all of the incredible abilities here is pretty intimidating. Especially since I get almost all of my projects from Upwork which is an outsourcing site. I believe I am competing directly with these frontier models in some circumstances. Like there are a ton of programmers who previously would be outsourcing work to that site, but now they as…
Im sorry to hear about your situation. Have you blogged about it? I’m curious about how the volume of your type of work has been changing over the past 2-3 years.
> Im sorry to hear about your situation. Have you blogged about it?
I don't know why but this made me laugh out loud. I know you're trying to help but just a funny jump
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#496They've also announced Qwen3.8-27B being released open-weight next week. Qwen3.6-27B is widely regarded as one of the best local models, especially since nothing else comes close to it, that isn't benchmaxxed, without being significantly larger. If 3.8 truly improves upon it that would be awesome.
Qwen3.8-Max is the first in Qwen-Max series to be open-weight as well. Kimi K3, GLM 5.2 and now Qwen3.8-Max - open weight models. DeepSeek V4 Flash outperforming Gemini 3.1 pro, probably DeepSeek V4 Pro update is also coming soon Chinese labs are cooking very hard. US closed weight labs are probably hard time to resist not calling Washington DC for more AI regulations
US AI companies are already sweating and 100% pressuring the Trump administration for more anti-Chinese regulation, since there have already been talk of Trump considering banning Chinese models. There's however another push back from the startup industry urging them not to ban it, since it will stifle the innovation. In other recent news OpenAI also greatly cut their model prices, 20% for 5.6 Terra and 80% for 5.6 Luna, to stay competitive.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#497Qwen3.8-35B-A3B would be really appreciated (-/\-)
The dream. Or a qwen-3.8-coder model.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#498As someone who is searching for a new programming contract right now, reading all of the incredible abilities here is pretty intimidating. Especially since I get almost all of my projects from Upwork which is an outsourcing site. I believe I am competing directly with these frontier models in some circumstances. Like there are a ton of programmers who previously would be outsourcing work to that site, but now they as…
Im sorry to hear about your situation. Have you blogged about it? I’m curious about how the volume of your type of work has been changing over the past 2-3 years.
I stopped blogging years ago when I realized that only bots were reading the posts.
I think the volume for custom agents is probably higher than ever but so is the competition for that work.
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#499Earlier quoted context omitted.
> All requests to an LLM are idempotent, for every API call you need to send it the entire conversation history A more appropriate term is “stateless”. LLM responses are certainly not idempotent, as they are not even deterministic.
They can be deterministic. We did this at Groq, if you sent a request with exactly the same input token, seed and temperature value you would get precisely the same result every time. This is harder to do on other architectures that themselves aren't fully deterministic though.
Do you mean that you get the exact same result (as word for word) because from Groq's documentation, it says that determinism is best effort, and also it's not guaranteed across model versions : https://console.groq.com/docs/prompting?_sm_vck=tMW2S7k17245...
My understanding is that it's best effort because even if you control the seed/temperature, the model version and hardware specs you still have floating point math that will introduce rounding differences
an article explaining this in detail : https://news.ycombinator.com/item?id=45200925
Re: Qwen3.8-Max: A New Bar for Coding and Cowork
#500Earlier quoted context omitted.
Yeah, here I am sitting deeply deeply deeply regretting not buying couple CMP 170HX at $200 or $350, knowing I could just flip them ethically at purchase price if nothing came of it... I could have just casually built a 128GB dual A100 local AI monster
I'm working with a lab that has a few Ampere GPUs on infiniband and they are just not compatible with the latest quants and vLLM updates. FP8 is about as low as you can go.
But they're reportedly a soft nerfed GA100 64GB/40GB at $1200, that's not more expensive and certainly can't be slower than a Mac Studio.