Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Qwen3-Coder-Next

qwen.ai

Post reply on HN
Print view View original

381–390 of 443 posts

Re: Qwen3-Coder-Next

#381

Post by simonw »

kristianp wrote: post #351
simonw wrote: post #3

This GGUF is 48.4GB - https://huggingface.co/Qwen/Qwen3-Coder-Next-GGUF/tree/main/... - which should be usable on higher end laptops. I still haven't experienced a local model that fits on my 64GB MacBook Pro and can run a coding agent like Codex CLI or Claude code well enough to be useful. Maybe this will be the one? This Unsloth guide from a sibling comment suggests it might be: https://unsloth.ai/docs/models/qwen3…

Why don't you try it out in Opencode? It's possible to hook up the openrouter api, and some providers have started to host it there [1]. It's not yet available in opencode's model list [2]. Opencode's /connect command has a big list of providers, openrouter is on there. [1] https://openrouter.ai/qwen/qwen3-coder-next [2] https://opencode.ai/docs/zen/#endpoints

Oh good! OpenRouter didn't have it this morning when I first checked.

Re: Qwen3-Coder-Next

#382

Post by hahajk »

Aurornis wrote: post #370
airstrike wrote: post #325

Earlier quoted context omitted.

right, but ChatGPT might not exist at some point, and if we don't force feed the open inference ecosystem and infrastructure back into the mouths of the AI devourer that is this hype cycle, we'll simply be accepting our inevitable, painful death

> right, but ChatGPT might not exist at some point There are multiple frontier models to choose from. They’re not all going to disappear.

the companies could merge or buy each other

Re: Qwen3-Coder-Next

#383

Post by brianjking »

simonw wrote: post #3

This GGUF is 48.4GB - https://huggingface.co/Qwen/Qwen3-Coder-Next-GGUF/tree/main/... - which should be usable on higher end laptops. I still haven't experienced a local model that fits on my 64GB MacBook Pro and can run a coding agent like Codex CLI or Claude code well enough to be useful. Maybe this will be the one? This Unsloth guide from a sibling comment suggests it might be: https://unsloth.ai/docs/models/qwen3…

TFW 48gb M4 Pro isn't going to run it.

Re: Qwen3-Coder-Next

#384

Post by Bukhmanizer »

Aurornis wrote: post #370
airstrike wrote: post #325

Earlier quoted context omitted.

right, but ChatGPT might not exist at some point, and if we don't force feed the open inference ecosystem and infrastructure back into the mouths of the AI devourer that is this hype cycle, we'll simply be accepting our inevitable, painful death

> right, but ChatGPT might not exist at some point There are multiple frontier models to choose from. They’re not all going to disappear.

This seems absurdly naive to me with the path big tech has taken in the last 5 years. There’s literally infinite upside and almost no downside to constraining the ecosystem for the big players.

You don’t think that eventually Google/OpenAI are going to go to the government and say, “it’s really dangerous to have all these foreign/unreglated models being used everywhere could you please get rid of them?”. Suddenly they have an oligopoly on the market.

Re: Qwen3-Coder-Next

#385

Post by nekitamo »

andai wrote: post #209
embedding-shape wrote: post #17

Earlier quoted context omitted.

> I still haven't experienced a local model that fits on my 64GB MacBook Pro and can run a coding agent like Codex CLI or Claude code well enough to be useful I've had mild success with GPT-OSS-120b (MXFP4, ends up taking ~66GB of VRAM for me with llama.cpp) and Codex. I'm wondering if maybe one could crowdsource chat logs for GPT-OSS-120b running with Codex, then seed another post-training run to fine-tune the 20b v…

Are you running 120B agentic? I tried using it in a few different setups and it failed hard in every one. It would just give up after a second or two every time. I wonder if it has to do with the message format, since it should be able to do tool use afaict.

This is a common problem for people trying to run the GPT-oss models themselves. Reposting my comment here:

GPT-oss-120B was also completely failing for me, until someone on reddit pointed out that you need to pass back in the reasoning tokens when generating a response. One way to do this is described here:

https://openrouter.ai/docs/guides/best-practices/reasoning-t...

Once I did that it started functioning extremely well, and it's the main model I use for my homemade agents.

Many LLM libraries/services/frontends don't pass these reasoning tokens back to the model correctly, which is why people complain about this model so much. It also highlights the importance of rolling these things yourself and understanding what's going on under the hood, because there's so many broken implementations floating around.

Re: Qwen3-Coder-Next

#386

Post by derac »

echelon wrote: post #77
giancarlostoro wrote: post #63

Earlier quoted context omitted.

I do wonder if they locked things down due to people abusing their CC token.

The loss of access shows the kind of power they'll have in the future. It's just a taste of what's to come. If a company is going to automate our jobs, we shouldn't be giving them money and data to do so. They're using us to put ourselves out of work, and they're not giving us the keys. I'm fine with non-local, open weights models. Not everything has to run on a local GPU, but it has to be something we can own. I'd l…

Kimi k2.5 is a good choice.

Re: Qwen3-Coder-Next

#387

Post by bytesandbits »

danielhanchen wrote: post #2

For those interested, made some Dynamic Unsloth GGUFs for local deployment at https://huggingface.co/unsloth/Qwen3-Coder-Next-GGUF and made a guide on using Claude Code / Codex locally: https://unsloth.ai/docs/models/qwen3-coder-next

how are you so fast man

Re: Qwen3-Coder-Next

#388

Post by Der_Einzige »

cmrdporcupine wrote: post #296
Der_Einzige wrote: post #245

Earlier quoted context omitted.

It literally always is. HN Thought DeepSeek and every version of Kimi would finally dethrone the bigger models from Anthropic, OpenAI, and Google. They're literally always wrong and average knowledge of LLMs here is shockingly low.

Nobody has been saying they'd be dethroned. We're saying they're often "good enough" for many use cases, and that they're doing a good job of stopping the Big Guys from creating a giant expensive moat around their businesses. Chinese labs are acting as a disruption against Altman etcs attempt to create big tech monopolies, and that's why some of us cheer for them.

"Nobody says X" is as presumptuous and wrong (both metaphorically and literally) as "LLMs can't do X". It is one of the worst thought terminating cliches.

Thousands have been saying this, you aren't paying attention.

Re: Qwen3-Coder-Next

#389

Post by cmrdporcupine »

Der_Einzige wrote: post #388
cmrdporcupine wrote: post #296

Earlier quoted context omitted.

Nobody has been saying they'd be dethroned. We're saying they're often "good enough" for many use cases, and that they're doing a good job of stopping the Big Guys from creating a giant expensive moat around their businesses. Chinese labs are acting as a disruption against Altman etcs attempt to create big tech monopolies, and that's why some of us cheer for them.

"Nobody says X" is as presumptuous and wrong (both metaphorically and literally) as "LLMs can't do X". It is one of the worst thought terminating cliches. Thousands have been saying this, you aren't paying attention.

As thought terminating as "HN Thought [insert strawman here]"

C'mon.

Re: Qwen3-Coder-Next

#390

Post by wincy »

christkv wrote: post #292
kristopolous wrote: post #255

Earlier quoted context omitted.

We need a new word, not "local model" but "my own computers model" CapEx based This distinction is important because some "we support local model" tools have things like ollama orchestration or use the llama.cpp libraries to connect to models on the same physical machine. That's not my definition of local. Mine is "local network". so call it the "LAN model" until we come up with something better. "Self-host" exists b…

I won't need a heater with that running in my room.

Haha running OSS-120B on my 5090 with most of the layers in video memory, some in RAM with LM Studio, I was hard pressed to get it to actually use anywhere near the full 600W. Gaming in 4K playing a modern game generates substantially more sustained heat.
Post reply on HN