Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Qwen3.8 Max now ranked as the best overall model by agentic index

artificialanalysis.ai

Post reply on HN
Print view View original

261–270 of 364 posts

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#261

Post by notfromhere »

jiggawatts wrote: post #157
d4rkp4ttern wrote: post #116

Earlier quoted context omitted.

All these "intelligence" benchmarks miss something extremely important when using an LLM in a code-agent harness: How it communicates with you about what it did. Opus-5 is practically unusable (for complex tasks) in this sense - its updates are voluminous, and dense with cryptic language (there are numerous reddit threads complaining about this, so it's not just me). I often have to ask it to re-state concisely in pl…

GPT 5.6 has similar language quirks that makes its comments nearly unusable. I wonder if this is a side effect of MoE models — they can write excellent prose, but not simultaneously with writing code.

I think it’s just where they focused RLHF resources. The models have generally only gotten worse at writing.

And writing doesn’t have validators like code so you can’t really scale it in the same way

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#262

Post by wanderlust123 »

aliasxneo wrote: post #253
monster_truck wrote: post #237

Earlier quoted context omitted.

Something I don't think many have internalized is that China has been as good or better for quite a while now (long before anyone was pointing distillation fingers) and enough people have finally tried it for themselves that the understanding has reached critical mass and the careful narrative of american companies is collapsing. When I finally put $15 into Deepseek and it beat the brakes off Codex 5.5 on multiple ra…

And I had the opposite experience. It's a really interesting phenomenon that I can't really explain. My co-founder swears by Deepseek and yet just the other day we were conversing and he was telling me about some of the issues with the way the AI was behaving and trying to show off the cool workarounds he came up with to limit it. I was like, "Interesting, yeah, I've literally never had that problem." I suspect that…

That’s not surprising. I have been using Deepseek and it consistently produces excellent output given the right context howevwr. It depends on the task as it does have blindspots.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#264

Post by HDBaseT »

veber-alex wrote: post #213
veber-alex wrote: post #204

Earlier quoted context omitted.

It takes 2 minutes to fix Opus 5 https://code.claude.com/docs/en/output-styles

lol. I am being downvoted for trying to help people out. This community is pure trash.

Instead, you should say something like:

"You can adjust the output style in your '.claude/settings.local.json' file".

OR

"You can decrease verbosity by doing x, y and z."

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#265

Post by vunderba »

cyanydeez wrote: post #260
vunderba wrote: post #231

Earlier quoted context omitted.

What really enrages me is the amount of effort it puts into justifying weaseling out of work. (THAT'S MY JOB!) It will do everything it can to defer or push it off, to the point where I’ve had to add multiple imperative directives to the AGENTS file telling it, in no uncertain terms, not to defer tasks under any circumstances.

sounds like someone needs a local llm.

Oh I do. Headless 128GB RAM machine serving llama.cpp with a number of local models that I use on a daily basis.

• Qwen3-VL picks up new images in a NAS, auto captions and adds the text descriptions as a hidden EXIF layer into the image, which is used for fast search and organization in conjunction with a Qdrant vector database.

• Gemma3:27b is used for personal translation work (mostly English and Chinese).

• Some small 8b models (like llama3.1) for sentiment analysis on text.

But haven't really tried using local LLMs in conjunction with agentic harnesses yet.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#266

Post by Cookingboy »

kadushka wrote: post #258
monster_truck wrote: post #237

Earlier quoted context omitted.

Something I don't think many have internalized is that China has been as good or better for quite a while now (long before anyone was pointing distillation fingers) and enough people have finally tried it for themselves that the understanding has reached critical mass and the careful narrative of american companies is collapsing. When I finally put $15 into Deepseek and it beat the brakes off Codex 5.5 on multiple ra…

Opus 5 and 5.6 Sol are definitely not smart enough to do my job. They require constant supervision. So why would I want to switch to even worse model? Even if it's just slightly worse?

>So why would I want to switch to even worse model?

There would be no reason to if you are in the privileged position where cost isn't an issue.

For the rest of us something that's 95% as good for 20% the price is a hell of a value proposition.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#267

Post by pessimizer »

cyanydeez wrote: post #257
monster_truck wrote: post #237

Earlier quoted context omitted.

Something I don't think many have internalized is that China has been as good or better for quite a while now (long before anyone was pointing distillation fingers) and enough people have finally tried it for themselves that the understanding has reached critical mass and the careful narrative of american companies is collapsing. When I finally put $15 into Deepseek and it beat the brakes off Codex 5.5 on multiple ra…

I think americans assume when they see a chinese or asian person working at an american business that they "escaped" china as opposed to just being rich enough to go to school abroad. and has little to no bearing on the amount of intelligent going around.

They've been continuously programmed with insane beliefs about China, which is less shocking when you understand what insane beliefs that they've had programmed into them about their neighbors. The world and your neighborhood are full of evil communists and Nazis who are trying to kill you all the time.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#268

Post by ethin »

capnjazz wrote: post #83
visarga wrote: post #44

Earlier quoted context omitted.

Sent to solve one task, came back with half of it solved and 2 more problems.

"One thing worth your attention", "Two things worth knowing", "One thing to eyeball"

I don't use Claude code, just Claude web, and I get this all the time. Or (since I have it push me to actually think) it will ask me some question in our back-and-forth, and then right after it'll provide the answer. As a "hint". Like come on

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#269

Post by miki123211 »

doginasuit wrote: post #198
jjcm wrote: post #166

China has caught up is the main takeaway here. The SOTA models are so close that it's really hard to compare them intelligence wise - you have to get a feel for them yourself and what works for you. What I'm really excited for is the 27B model. 3.6 is still the king of local, and if 3.8 makes the same improvements it could really legitimately make local viable as a default. I'd love to run a perpetual agent on 3.8 th…

Another potential takeaway is that the models all gathering around the same point supports the idea that there is a ceiling to LLM capability.

I don't think there's a ceiling to LLM capability. I do think that many software dev tasks are just far below that ceiling, and the gains to most dev work won't be that large from now on.

Where the new generation of LLMs (Fable, Sol) shines is tasks that are much harder than typical soft eng, yet that still have a verifiable answer, think mathematical proofs or exploits. I think there's still a good amount of low-hanging fruit in those (and similar) areas.

The next frontier after that is tasks that don't have automatically-verifiable answers, and may not even have correct and incorrect ones in the strictest sense of the word.

Reasonable lawyers might disagree on the question of "which trial strategy do I use given the following set of facts." There are answers that are clearly wrong, but being able to choose between many plausibly-correct ones requires many years of lawyering and seeing many trials play out. I do suspect that most lawyers are far below the ceiling that a hypothetical immortal lawyer that has practiced for an infinite amount of time would have achieved.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#270

Post by cyanydeez »

vunderba wrote: post #265
cyanydeez wrote: post #260

Earlier quoted context omitted.

sounds like someone needs a local llm.

Oh I do. Headless 128GB RAM machine serving llama.cpp with a number of local models that I use on a daily basis. • Qwen3-VL picks up new images in a NAS, auto captions and adds the text descriptions as a hidden EXIF layer into the image, which is used for fast search and organization in conjunction with a Qdrant vector database. • Gemma3:27b is used for personal translation work (mostly English and Chinese). • Some s…

recommend opencode w/qwen 35B or 27B with MTP.

My secret sauce is to use LLAMAcpp's reasoning-budget and reasoning-message that trigger cut off to overthinking with a message that says to either us subagents or compress the context. opencode's dynamic context pruning plugin can get you pretty far into the stratosphere.

Post reply on HN