Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.2 is the new leading open weights model on Artificial Analysis

artificialanalysis.ai

Post reply on HN
Print view View original

151–160 of 476 posts

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#151

Post by snsnbsne »

slig wrote: post #115
kristopolous wrote: post #104

I have a script that ranks these based on codingindex from Artificial Analysis. All it does is pull a json from their main table page and parses it with the fields I care about (coding). There used to be a mailing list associated with it but eh ... there wasn't much interest. I use the script every day though. Current partial output score age size name 47.1 58 large Kimi K2.6 47.5 54 large DeepSeek V4 Pro (Reasoning,…

Thanks for sharing. I'm curious: why didn't you sort with the score descending?

Because programmers can’t figure out how to have a CLI that prints in a normal order, with the newest stuff on top instead of on the bottom.

Setup a fresh new large monitor. Open CLI. Run command. Watch output at the bottom of your screen. Keep watching the bottom of your screen for the rest of the day.

Sure you can tile windows and it helps but come on. Just have the command/input section in the bottom and the “output” on top. Keep the command bit on the bottom.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#152

Post by segmondy »

Pragmata wrote: post #56

So this basically means we will have a near opus level model able to be run locally in the next couple of months right? QWEN 3.6 27b is already pretty good, but it should be possible to get a better option now that runs in the same hardware, right?

Why wait for the next few months? There are plenty of better models that you can run today locally. Qwen3.5-397B beats Qwen3.6-27B. MiniMax2.7 is a longrun horizon monster. (I haven't given 3 much of a try yet). KimiK2.6/2.7, MiMoV2.5/MiMoV2.5-Pro and GLM5.1 will wreck Qwen3.6-27B any day on any task.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#153

Post by eckelhesten »

granra wrote: post #117
eckelhesten wrote: post #91

Sure, but whatever you do, don't buy their (Z.ai) lite plan. I feel like i threw 15 dollars in the sea. I'm getting rate limited after 3-4 prompts. You get way less value than just paying 25 dollars for Claude or OpenAI models.

How are you using it? I have the lite plan and I've only ever maxed my weekly usage a few hours before reset. I will concede that I'm not a super heavy LLM user but it's been really good for me. My workflow is usually: - read file. I want to achieve X, how do? Do not implement anything. - I would do a, b and c - sketch a brief implementation of your suggestion - (not writing files yet) - instead of your approach x, w…

Try pointing it to a small codebase, or even ask it to conjure information found online.

You'll see that it quickly gives up. Thing is, they seem to count cached hits as if they were the non-cached tokens.

I wont be subscribing again thats for sure. I am not paying iPhone money for a Xiaomi.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#154

Post by Certhas »

tcp_handshaker wrote: post #137
papersail wrote: post #130

Earlier quoted context omitted.

score age size name 62.0 8 - Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) 59.1 55 - GPT-5.5 (xhigh) 58.5 55 - GPT-5.5 (high) 57.2 104 - GPT-5.4 (xhigh) 56.7 20 - Claude Opus 4.8 (Adaptive Reasoning, Max Effort) 56.2 55 - GPT-5.5 (medium) 55.5 118 - Gemini 3.1 Pro Preview 53.1 132 - GPT-5.3 Codex (xhigh) 53.1 62 - Claude Opus 4.7 (Non-reasoning, High Effort) 52.5 62 - Claude Opus 4.7 (Adaptive Re…

Short comments... - GPT 5.5 consistently the best, an opinion who gets me constant downvotes here by the Anthropic Marketeer strike force... - China is going to eat the US lunch on AI - What have European universities and companies been doing? Its like if, on a parallel past/future, Nikola Tesla and Edison would have created flying Cyberpunk machines, while Europeans researchers, would be getting together to request…

None of these models come from universities, European or otherwise.

Mistral is clearly currently not competing for Frontier Model. Whether this is due to a lack of VC Funds or a lack of technical ability or the former arising from the latter would be interesting to know.

The top models are from startups. Among the FAANG only Google managed to get a Frontier model, and they litterally invented the architecture and have more money than they can possibly spend to throw at the problem. Facebook shows that even ungodly amounts of money don't get you there though.

So why did no EU based Startups succeed while two US start ups succeeded? I agree that that's a very important question the EU should ask. The Internet revolution was driven by US companies, and now AI will be as well, with Chinese Open Weights mixed in. The EU consistently can not turn its considerable economic output into fast moving tech firms.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#155

Post by giancarlostoro »

xstas1 wrote: post #140
giancarlostoro wrote: post #112

Earlier quoted context omitted.

I usually have Claude build a plan first, then I put it into an XML file it updates with phases, usually we talk about some of those tasks, and then once its good and I like it, I have Claude implement the plan. Another thing I tell Claude to do is to not guess, but look at documentation, it messes up a lot less, might use some tokens reading docs, but at least it has a higher success rate code wise.

XML??

Apparently because of how Claude is trained, even the system level prompts go through as XML, it works better with XML "prompting" so I figured I could have it write plans in XML. I need to update my ticketing tool to output XML maybe by default.

https://www.reddit.com/r/ClaudeAI/comments/1psxuv7/anthropic...

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#156

Post by m-dot-reviews »

For anyone who's interested, I've put together a simple site for sharing ratings/opinions on models at a task-specific granularity. https://model.reviews/

The idea is that benchmark score comparisons are useful for a large cross-product comparison across models + their settings, but less useful if you're looking for the best model for . So I thought having a place to review and comment could be beneficial to people.

I'm not sure how best to get the corpus bootstrapped (i.e. people will likely only visit/post on the site if there's already activity), so posting it here for anyone who'd like to contribute.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#157

Post by kristopolous »

datadrivenangel wrote: post #142
kristopolous wrote: post #131

Earlier quoted context omitted.

then I'd have to scroll up over 500 lines after running it every time to see what I care about. But if that's your thing, here you go: https://github.com/day50-dev/aa-eval-email/commit/1853be6461... add an argument (any argument) and it will be sorted as your specified. It just works as a toggle flipping the order ... so literally any string will do. The original link has been updated accordingly with the new code.

Have it print paginated or just top 10?

only the small ones:

  $ ./art-analysis.sh | grep small
or maybe just the qwen

  $ ./art-analysis.sh | grep Qwen
only the ones in the past 30 days

  $ ./art-analysis.sh | awk '$2
I use it in pipes like this.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#158

Post by segmondy »

XCSme wrote: post #68
XCSme wrote: post #67

Earlier quoted context omitted.

Which Opus? GLM-5.2 is already close to Opus-4.7 level: https://aibenchy.com/compare/anthropic-claude-opus-4-7-mediu...

Oh, or you meant a smaller model than GLM-5.2 with similar capabilities?

Probably not. Qwen3.(5|6)-27B seems like an "accidental freak". I'm not even sure they know what they did to create that. A decent amount of the team members left after that, so unfortunately, we might not be seeing another small model that packs such a punch for a while. Hopefully the team is studying their entire training recipe for that and is able to replicate. If they are, then a 50-70B dense model might give us such capabilities...

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#159

Post by tasuki »

duckmysick wrote: post #144
kristopolous wrote: post #128

Earlier quoted context omitted.

Because it's currently 511 lines. Why would I want to scroll up to see the stuff I care about? Don't you want the relevant stuff to be right there in front of you?

I do and that's why I pipe the output to `head -n 20` or use `LIMIT 20` in SQL. That aside, this is a good script you're running. Thanks.

But maybe you decide you want to see more. It makes perfect sense for a cli tool to output the most interesting piece of info last: then you can decide on the fly whether you want to scroll up or not.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#160

Post by Pragmata »

segmondy wrote: post #152
Pragmata wrote: post #56

So this basically means we will have a near opus level model able to be run locally in the next couple of months right? QWEN 3.6 27b is already pretty good, but it should be possible to get a better option now that runs in the same hardware, right?

Why wait for the next few months? There are plenty of better models that you can run today locally. Qwen3.5-397B beats Qwen3.6-27B. MiniMax2.7 is a longrun horizon monster. (I haven't given 3 much of a try yet). KimiK2.6/2.7, MiMoV2.5/MiMoV2.5-Pro and GLM5.1 will wreck Qwen3.6-27B any day on any task.

[dead]
Post reply on HN