Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
1–10 of 286 posts
Re: Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
#2[flagged]
Re: Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
#3[flagged]
Yes.
Re: Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
#4Are there any non-Chinese open models that offer comparable performance?
Re: Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
#5Is this actually true? I want to see actual evals that match this up with Sonnet 4.5.
Re: Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
#6Is this actually true? I want to see actual evals that match this up with Sonnet 4.5.
Not exactly, but pretty close: https://artificialanalysis.ai/models/capabilities/coding?mod...
Somewhere between Haiku 4.5 and Sonnet 4.5
Re: Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
#7[flagged]
Ironically, chinese models so far have been less lobotomized compared to OAI and Anthropic's models
Re: Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
#8The new 35b model is great. That said, it has slight incompatibility's with Claude Code. It is very good for tool use.
Re: Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
#9What kind of hardware does HN recommend or like to run these models?
Re: Qwen3.5 122B and 35B models offer Sonnet 4.5 performance on local computers
#10What kind of hardware does HN recommend or like to run these models?
It's less than you'd think. I'm using the 35B-A3B model on an A5000, which is something like a slightly faster 3080 with 24GB VRAM. I'm able to fit the entire Q4 model in memory with 128K context (and I think I would probably be able to do 256K since I still have like 4GB of VRAM free). The prompt processing is something like 1K tokens/second and generates around 100 tokens/second. Plenty fast for agentic use via Opencode.