[dead]
Qwen3.7-Max: The Agent Frontier
201–210 of 317 posts
Re: Qwen3.7-Max: The Agent Frontier
#202Checking openrouter (it's not available yet) and, uh, what's up with the spike in Qwen usage from early april here? https://openrouter.ai/qwen
Is this normal humans kicking the tires on a new model, or a few whales doing serious benchmarks?
Re: Qwen3.7-Max: The Agent Frontier
#203Checking openrouter (it's not available yet) and, uh, what's up with the spike in Qwen usage from early april here? https://openrouter.ai/qwen Is this normal humans kicking the tires on a new model, or a few whales doing serious benchmarks?
personally seen a lot of people switch to Kimi and Qwen after Opus 4.7. Kimi 2.6 feels like Opus 4.6 which, to me, was a great model for 98% of coding tasks
Re: Qwen3.7-Max: The Agent Frontier
#204Checking openrouter (it's not available yet) and, uh, what's up with the spike in Qwen usage from early april here? https://openrouter.ai/qwen Is this normal humans kicking the tires on a new model, or a few whales doing serious benchmarks?
Qwen 3.6 Plus released and they offered it for free
Re: Qwen3.7-Max: The Agent Frontier
#205Earlier quoted context omitted.
Out of interest, what machine and model are you running it on? I tried the qwen3.6-27b Q6_k GUFF in llama.cpp and LM Studio on my M2 MacBook Pro 32GB machine last week, and I barely get a token a second with either. What sort of speed should I be expecting? I tried some of the Llama 3 34b (nous-capybara?) models two years ago with llama.cpp, and I seem to remember getting a few tokens a second then, so not sure if I'…
I tried the qwen3.6-27b Q6_k GUFF in llama.cpp and LM Studio on my M2 MacBook Pro 32GB machine last week, and I barely get a token a second with either. The fact that it was this slow makes me suspect it's a matter of insufficient free RAM. The entire model needs to fit into RAM (and stay there the entire time) for acceptable performance. (not sure of exact diagnosis/fix, but definitely look in that direction if you'…
You are using Q6 6 bit quantization; on my 32G MacMini I use Q4 and it is faster but when I use it with OpenCode, I set up a task and go outside to walk for ten minutes. Smart, capable, and slow. Still, I love using local models.
EDIT: I run with context wired at 64K
Re: Qwen3.7-Max: The Agent Frontier
#206Checking openrouter (it's not available yet) and, uh, what's up with the spike in Qwen usage from early april here? https://openrouter.ai/qwen Is this normal humans kicking the tires on a new model, or a few whales doing serious benchmarks?
personally seen a lot of people switch to Kimi and Qwen after Opus 4.7. Kimi 2.6 feels like Opus 4.6 which, to me, was a great model for 98% of coding tasks
Frontier: Need it done quick and I'm willing to pay.
Open-weight: Good enough for the majority of tasks, and I'm willing to spend a bit more time and effort steering towards my desired result.
Re: Qwen3.7-Max: The Agent Frontier
#207Earlier quoted context omitted.
Well, yes, garbage in garbage out. That's a given and not what's meant by "hallucination" in this context.
the observation goes beyond garbage in garbage out. Mainly that we're always operating from some prior and limited understanding. That what may look like a hallucination could be closer to the truth than our current frameworks of understanding allow us to admit. The hermeneutic circle.
Interesting. I wonder if current LLMs can break out of human limitations and understand the world more correctly.
Re: Qwen3.7-Max: The Agent Frontier
#208Earlier quoted context omitted.
How do you use DeepSeek 4 Flash? Via a cli?
I use their VSCode extension: https://marketplace.visualstudio.com/items?itemName=sst-dev.... It adds a button to VSCode to open a tab with opencode loaded. It's a bit better than just opening the CLI because it has some vscode integration. With their $10/mo opencode go plan: https://opencode.ai/go For my use it's about endless use of DS4 Flash on high setting. I find high better than max because it's less chatty. Th…
How is that extension compared to, say, DS4 via OpenRouter and the usual VSCode Copilot panel?
Re: Qwen3.7-Max: The Agent Frontier
#209Earlier quoted context omitted.
All this data is accessible to national security agencies; this is true in every country in the world. China has more integration between intelligence and industry than many western countries, and it does present a higher risk of unwanted “tech transfer” to industry than running on oracle or Google or ms or Amazon does in the US. DHS has long staffed full time agents in California to deal with foreign IP exfiltration…
I highly doubt China has a more sophisticated integration of their intelligence ministries than the USA. The world in which that was true would look very different from our own.
He didn't say more sophisticated integration. He said 'more integration', which is very likely true.
Re: Qwen3.7-Max: The Agent Frontier
#210Earlier quoted context omitted.
Out of interest, what machine and model are you running it on? I tried the qwen3.6-27b Q6_k GUFF in llama.cpp and LM Studio on my M2 MacBook Pro 32GB machine last week, and I barely get a token a second with either. What sort of speed should I be expecting? I tried some of the Llama 3 34b (nous-capybara?) models two years ago with llama.cpp, and I seem to remember getting a few tokens a second then, so not sure if I'…
There are two flavors of Qwen 3.6: - A 27B "dense" model - A 35B "Mixture of Experts" model, which activates only 3B parameters for each token. For your hardware, I strongly recommend `unsloth/Qwen3.6-35B-A3B-GGUF:Q4_K_M`. I have an M1 Max with 32GB VRAM from 2021 that can read at ~300-500 tokens/sec and write at ~30 tokens/sec with llama-cpp's default settings, which is plenty fast. The 27B model can read ~70tok/sec…
For coding tasks 27B is reported to be much more effective, altho you can probably only run 4b or 5b quants @ this memory.
Recommend https://www.reddit.com/r/LocalLLaMA/ as a great source for this type of discussion.