Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Qwen3.8 Max now ranked as the best overall model by agentic index

artificialanalysis.ai

Post reply on HN
Print view View original

91–100 of 364 posts

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#91

Post by ahartmetz »

h14h wrote: post #74
d2p wrote: post #71

I clicked through and it showed Qwen at the top at 55.4 compared to 55.3 for Opus Max. I have a screenshot. Then I clicked away and back, and now it goes Qwen second, with 58.4, to Opus Max at top with 59.2. I have screenshots of both. The description above the chart is the same in boh cases: > Artificial Analysis Agentic Index > Represents the weighted average of agentic capabilities benchmarks in the Artificial Ana…

They JUST updated their methodology: https://artificialanalysis.ai/methodology/intelligence-bench... Edit to provide AA's article explaining it: https://artificialanalysis.ai/articles/artificial-analysis-i...

Fixed the result, eh? In both senses of the word.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#92

Post by petesergeant »

garciasn wrote: post #67
copperx wrote: post #41

Earlier quoted context omitted.

I'm dumbfounded to see Opus 5 making SO MANY mistakes in coding simple stuff. Most times, Fable 5 comes out to be cheaper because it nails so many things much quicker than Opus 5.

I have Fable plan and Opus implement. I haven't had any major issues working this way; however, Opus does seem plain fucking stupid compared to what I experienced with Sonnet previously.

> however, Opus does seem plain fucking stupid

Infuriatingly so, in a way I don't remember Opus 4.8 being, but maybe I've just been ruined by Fable 5.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#94

Post by iAMkenough »

Gooblebrai wrote: post #86
eli wrote: post #38

Earlier quoted context omitted.

I use https://pi.dev/ which works fine out of the box but is fairly minimal and intended to be customized. There are many extensions. OpenCode or oh-my-pi might make more sense if you just want a batteries-included agent. You can also make Claude Code work with other models without too much work, but I think that's asking for headaches.

Is there any subscription of any kind for Qwen? Or via Pi.dev needs to be used with API credits?

My first web search turned up this as the top result https://www.alibabacloud.com/help/en/model-studio/coding-pla...

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#95

Post by tempest_ »

aenis wrote: post #84
theropost wrote: post #60

Anthropic is a bit nuts, I had $260 of credits on my max account for the extra usage the other night. It was expiring, so I figured I'll fire up an agentic swarm to deep dive and make some deep changes to some old cold bases.. literally 25 minutes or less, $260 burnt, it didn't get get into the implementation, just wrote a ton of useless plans for the most part. It really opened my eyes to what they expect to charge…

I managed to lose around $300 in credits I had saved for some emergency /fast sessions the following way: switch to Fable. Work on the design. Downgrade to Opus for the build. If any of other parallel Opus session has /fast enabled it seems to enable it for the newly spawned session by default. Before I knew it, the $300 was gone. I think the bug is now solved, but it was rather unpleasant. I dont ever remember bugs…

I dont love it.

Opus 5 is just a token burner.

I use fable plan and spawn opus 4.8 workflows which seems to work alright.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#96

Post by pornel »

logicchains wrote: post #48
onomojo wrote: post #34

Any benchmark showing Opus 5 as the best just loses credibility for me. Anyone who's actually used Opus 5 daily knows what I'm talking about.

"As you requested, I've finished task X. Honestly, task X turned out to require task Y, which I haven't actually done. Task Y is the next step if you'd like to continue along this route."

This is the hard-won load-bearing quote.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#97

Post by seizethecheese »

Opus is still first in Intelligence Index followed by Fable, GPT 5.6, Kimi K3 then Qwen 3.8 max. https://artificialanalysis.ai/#intelligence

Our leaderboard combines Arena ELO, AA Intelligence index, latency and speed and goes: #1 Opus 5 #2 Kimi K3 #3 Qwen3.8 Max #4 GPT 5.6 Sol

Source: http://pellmell.ai/leaderboard.

This jumps around a lot based on the top throughput and latency of whatever provider happens to be best at the moment.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#99

Post by AlexandrB »

cortesoft wrote: post #65
theropost wrote: post #60

Anthropic is a bit nuts, I had $260 of credits on my max account for the extra usage the other night. It was expiring, so I figured I'll fire up an agentic swarm to deep dive and make some deep changes to some old cold bases.. literally 25 minutes or less, $260 burnt, it didn't get get into the implementation, just wrote a ton of useless plans for the most part. It really opened my eyes to what they expect to charge…

It’s crazy how different the credit cost and subscription cost are. With the $200 subscription, I can have Fable on ultracode working for hours and not dent the usage limits.

VCs are footing the bill for that $200 subscription.

Re: Qwen3.8 Max now ranked as the best overall model by agentic index

#100

Post by apitman »

d2p wrote: post #71

I clicked through and it showed Qwen at the top at 55.4 compared to 55.3 for Opus Max. I have a screenshot. Then I clicked away and back, and now it goes Qwen second, with 58.4, to Opus Max at top with 59.2. I have screenshots of both. The description above the chart is the same in boh cases: > Artificial Analysis Agentic Index > Represents the weighted average of agentic capabilities benchmarks in the Artificial Ana…

Welp. That didn't last long
Post reply on HN