Looking forward to more open weight releases from Qwen, especially 122B and 397B.
Personally even more a lower quantized model like 9B.
Qwen3.7-Max: The Agent Frontier
141–150 of 317 posts
Re: Qwen3.7-Max: The Agent Frontier
#142I can't bring myself to use any model that trains or sends telemetry back to my country's primary competitor/adversary. I don't care how much money is saved.
assuming that country is the united states, why not? seems like an honourable thing to do if anything, lol
Re: Qwen3.7-Max: The Agent Frontier
#143Earlier quoted context omitted.
All this data is accessible to national security agencies; this is true in every country in the world. China has more integration between intelligence and industry than many western countries, and it does present a higher risk of unwanted “tech transfer” to industry than running on oracle or Google or ms or Amazon does in the US. DHS has long staffed full time agents in California to deal with foreign IP exfiltration…
I highly doubt China has a more sophisticated integration of their intelligence ministries than the USA. The world in which that was true would look very different from our own.
Interesting. Have you worked in China?
Re: Qwen3.7-Max: The Agent Frontier
#144Earlier quoted context omitted.
There is no reason why they couldn't license the model to Friendli/Fireworks/etc and have it hosted in the US to alleviate this concern.
The reason is to create domestic demand for Chinese AI chips so they can eventually be free of NVIDIA.
Replacing NVIDIA is not a problem, replacing ASML is.
Re: Qwen3.7-Max: The Agent Frontier
#145I really like what Qwen are doing, and a lot of these Chinese labs, but until I can ask their models what happened during the student protests in 1989 or why human rights groups are upset about the Uighurs and the model gives me a straight answer I'm just not able to trust these models with anything of substance.
This is silly. Would you perform the same test against Western models in asking them whether Israel is a genocidal apartheid state? It'll give you the same roundabout explanations and "some say no some say yes" responses that you'll get from asking Qwen about Uighurs or the protests of 1989.
Re: Qwen3.7-Max: The Agent Frontier
#146Earlier quoted context omitted.
What do you recommend for non-Mac setup? I am a Mac user, but its getting expensive, and not seeing reason to jump to the latest M5
Try looking into Ryzen AI Max 395. AMD made a CPU/GPU soc with unified memory specifically for ai inference. Can buy mini PCs with up to 128gb ram.
Isn't CUDA/nvidia the go to solution for most local models, with the rest being second class citizents?
Re: Qwen3.7-Max: The Agent Frontier
#147As they start to release more proprietary models, I so wish that they partnered with one of the major US hyperscalers to allow using these models through something US-domiciled. Totally understand why it may not be reasonable or in their best interest (and that the US is _absolutely_ not doing the same reflexively). But it would be lovely to be able to try these out on production workloads in earnest.
I'm more interested in hearing specific reasons why one wouldn't use a Chinese company. Unless you're thinking Alibaba is going to ship chat logs to some government ministry that will then dole out proprietary information to new competitors (which doesn't seem logistically feasible), or you run a human rights organization, it feels a bit like FUD.
[dead]
Re: Qwen3.7-Max: The Agent Frontier
#148I can't bring myself to use any model that trains or sends telemetry back to my country's primary competitor/adversary. I don't care how much money is saved.
Yeah, I prefer my data to be used and trained by the very trustworthy and benevolent tech oligarchs in my home country.
Re: Qwen3.7-Max: The Agent Frontier
#149I really like what Qwen are doing, and a lot of these Chinese labs, but until I can ask their models what happened during the student protests in 1989 or why human rights groups are upset about the Uighurs and the model gives me a straight answer I'm just not able to trust these models with anything of substance.
Just download a heretic abliterated versionof the model you want to use. I believe those are the current state of the art for uncensored models.
Re: Qwen3.7-Max: The Agent Frontier
#150I was getting dangerously close to my weekly Claude Code limit last night so I had Claude set up Qwen3.6 with llama.cpp and OpenCode. Honestly it's a great (free!) alternative to Claude Code--certainly more than good enough for a lot of smaller less complex tasks. I'm excited to try this new version. The fact that open-source models are so close to the frontier is very impressive.
Out of interest, what machine and model are you running it on?
I tried the qwen3.6-27b Q6_k GUFF in llama.cpp and LM Studio on my M2 MacBook Pro 32GB machine last week, and I barely get a token a second with either.
What sort of speed should I be expecting?
I tried some of the Llama 3 34b (nous-capybara?) models two years ago with llama.cpp, and I seem to remember getting a few tokens a second then, so not sure if I've got something completely mis-configured, or I just have unreasonable expectations.
Or maybe qwen 3.x is slower for some reason? (Is it mixture of experts?)
I'm not expecting it to be instant, but what I'm currently seeing is not really usable.