Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Qwen3-Coder-Next

qwen.ai

Post reply on HN
Print view View original

431–440 of 443 posts

Re: Qwen3-Coder-Next

#431

Post by andai »

nekitamo wrote: post #385
andai wrote: post #209

Earlier quoted context omitted.

Are you running 120B agentic? I tried using it in a few different setups and it failed hard in every one. It would just give up after a second or two every time. I wonder if it has to do with the message format, since it should be able to do tool use afaict.

This is a common problem for people trying to run the GPT-oss models themselves. Reposting my comment here: GPT-oss-120B was also completely failing for me, until someone on reddit pointed out that you need to pass back in the reasoning tokens when generating a response. One way to do this is described here: https://openrouter.ai/docs/guides/best-practices/reasoning-t... Once I did that it started functioning extreme…

I used it with OpenAI's Codex, which had official support for it, and it was still ass. (Maybe they screwed up this part too? Haha)

Re: Qwen3-Coder-Next

#432

Post by CamperBob2 »

simonw wrote: post #335
technotony wrote: post #263

Earlier quoted context omitted.

what are your impressions?

I got Codex CLI running against it and was sadly very unimpressed - it got stuck in a loop running "ls" for some reason when I asked it to create a new file.

You probably have seen it by now, but there was a llama.cpp issue that was fixed earlier today(?) to avoid looping and other sub-par results. Need to update llama-server as well as redownload the GGUFs (for certain quants).

https://old.reddit.com/r/unsloth/comments/1qvt6qy/qwen3coder...

Re: Qwen3-Coder-Next

#433

Post by simonw »

CamperBob2 wrote: post #432
simonw wrote: post #335

Earlier quoted context omitted.

I got Codex CLI running against it and was sadly very unimpressed - it got stuck in a loop running "ls" for some reason when I asked it to create a new file.

You probably have seen it by now, but there was a llama.cpp issue that was fixed earlier today(?) to avoid looping and other sub-par results. Need to update llama-server as well as redownload the GGUFs (for certain quants). https://old.reddit.com/r/unsloth/comments/1qvt6qy/qwen3coder...

I hadn't seen that, thanks very much!

Re: Qwen3-Coder-Next

#434

Post by kristopolous »

Aurornis wrote: post #370
airstrike wrote: post #325

Earlier quoted context omitted.

right, but ChatGPT might not exist at some point, and if we don't force feed the open inference ecosystem and infrastructure back into the mouths of the AI devourer that is this hype cycle, we'll simply be accepting our inevitable, painful death

> right, but ChatGPT might not exist at some point There are multiple frontier models to choose from. They’re not all going to disappear.

Yes they are.

It'll all be open weights commodity just like all Unix vendors disappeared

Re: Qwen3-Coder-Next

#435

Post by mirekrusin »

SamDc73 wrote: post #430
mirekrusin wrote: post #404

Earlier quoted context omitted.

What are you talking about? Qwen3-Coder-Next supports 256k context. Did you wanted to say that you don't have enough memory to run it locally yourself?

Yes! I tried to go as far as 32k on the context window but beyond that it won't be usable on my laptop (Ryzen AI 365, 32gb RAM and 6gb of VRAM)

You need minimum ie. 2x 24G GPUs for this model (you need 46GB minimum).

Re: Qwen3-Coder-Next

#436

Post by breakingcups »

codazoda wrote: post #319
zackify wrote: post #317

Earlier quoted context omitted.

I'm using this model right now in claude code with LM Studio perfectly, on a macbook pro

You mean Qwen3-Coder-Next? I haven't tried that model itself, yet, because I assume it's too big for me. I have a modest 16GB MacBook Air so I'm restricted to really small stuff. I'm thinking about buying a machine with a GPU to run some of these. Anywayz, maybe I should try some other models. The ones that haven't worked for tool calling, for me are: Llama3.1 Llama3.2 Qwen2.5-coder Qwen3-coder All these in 7b, 8b, o…

I've not used Ollama in a long time, but I believe it aggressively quantizes models by default, leading to subpar performance.

Re: Qwen3-Coder-Next

#439

Post by Hackbraten »

redwood_ wrote: post #369
mittermayr wrote: post #223

Earlier quoted context omitted.

what do you run this on if I may ask? lmstudio, ollama, lama? which cli?

I run Qwen3-Coder-Next (Qwen3-Coder-Next-UD-Q4_K_XL) on the Framework ITX board (Max+ 395 - 128GB) custom build. Avg. eval at 200-300 t/s and output at 35-40 t/s running with llama.cpp using rocm. Prefer Claude Code for cli.

Curiously, how come you chose -Q4_K_XL instead of -Q8_K_XL?

Re: Qwen3-Coder-Next

#440

Post by yencabulator »

hedora wrote: post #359
christkv wrote: post #292

Earlier quoted context omitted.

I won't need a heater with that running in my room.

This looks like it’ll run easily on a Strix Halo (180W TDP), and be a little sluggish on previous gen AMDs (80W TDP). I can’t be bothered to check TDPs on 64GB macbooks, but none of these devices really count as space heaters.

For the record, a typical US space heater is 1500 W. We're talking a small fraction of a space heater.

(Not that I'd want one in my office in the summertime, but I also wouldn't want the fan noise.)

Post reply on HN