Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.2 is the new leading open weights model on Artificial Analysis

artificialanalysis.ai

Post reply on HN
Print view View original

161–170 of 476 posts

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#161

Post by bodhi_mind »

kristopolous wrote: post #104

I have a script that ranks these based on codingindex from Artificial Analysis. All it does is pull a json from their main table page and parses it with the fields I care about (coding). There used to be a mailing list associated with it but eh ... there wasn't much interest. I use the script every day though. Current partial output score age size name 47.1 58 large Kimi K2.6 47.5 54 large DeepSeek V4 Pro (Reasoning,…

Cool project! Side note: Kind of a bad practice imo to ask people to blindly execute bash from an unknown source.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#162

Post by kristopolous »

Certhas wrote: post #154
tcp_handshaker wrote: post #137

Earlier quoted context omitted.

Short comments... - GPT 5.5 consistently the best, an opinion who gets me constant downvotes here by the Anthropic Marketeer strike force... - China is going to eat the US lunch on AI - What have European universities and companies been doing? Its like if, on a parallel past/future, Nikola Tesla and Edison would have created flying Cyberpunk machines, while Europeans researchers, would be getting together to request…

None of these models come from universities, European or otherwise. Mistral is clearly currently not competing for Frontier Model. Whether this is due to a lack of VC Funds or a lack of technical ability or the former arising from the latter would be interesting to know. The top models are from startups. Among the FAANG only Google managed to get a Frontier model, and they litterally invented the architecture and hav…

I'm actually more curious about IBM. Their granite series appears to be nowhere close to competitive.

They had Watson, remember, it won on jeopardy like 15 years ago? They've been at this for a long time

Maybe it's good at something else?

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#163

Post by bel8 »

papersail wrote: post #130
kristopolous wrote: post #104

I have a script that ranks these based on codingindex from Artificial Analysis. All it does is pull a json from their main table page and parses it with the fields I care about (coding). There used to be a mailing list associated with it but eh ... there wasn't much interest. I use the script every day though. Current partial output score age size name 47.1 58 large Kimi K2.6 47.5 54 large DeepSeek V4 Pro (Reasoning,…

score age size name 62.0 8 - Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) 59.1 55 - GPT-5.5 (xhigh) 58.5 55 - GPT-5.5 (high) 57.2 104 - GPT-5.4 (xhigh) 56.7 20 - Claude Opus 4.8 (Adaptive Reasoning, Max Effort) 56.2 55 - GPT-5.5 (medium) 55.5 118 - Gemini 3.1 Pro Preview 53.1 132 - GPT-5.3 Codex (xhigh) 53.1 62 - Claude Opus 4.7 (Non-reasoning, High Effort) 52.5 62 - Claude Opus 4.7 (Adaptive Re…

you left some models out like DeepSeek and Kimi, for example.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#164

Post by segmondy »

JustSkyfall wrote: post #118

The problem with these benchmarks is that the Chinese models tend to be incredible on paper, and absolutely terrible in practice :/

You are obviously lying because it shows you have no experience with. GLM since 4.5 have been crushing it. all their models since then haven't skipped a beat. 4.5/4.5-air, 4.6, 4.7, 4.8, 5, 5.1. That aside, MiMoV2.5, MiniMax from 2.0, DeepSeek from V3, Kimi since V2, Qwen since 3, Hy3 have all been amazing models. All from China, we need to get over it. China is not losing yet as far as the AI race is concerned.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#165

Post by [deleted] »

tasuki wrote: post #159
duckmysick wrote: post #144

Earlier quoted context omitted.

I do and that's why I pipe the output to `head -n 20` or use `LIMIT 20` in SQL. That aside, this is a good script you're running. Thanks.

But maybe you decide you want to see more. It makes perfect sense for a cli tool to output the most interesting piece of info last: then you can decide on the fly whether you want to scroll up or not.

[deleted]

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#166

Post by segmondy »

rahidz wrote: post #24

Correct me if I'm wrong, but neither DeepSeek nor GLM have image input modality. This makes them less useful when looking at UIs, photos, screenshots, etc. doesn't it? Or do they have alternate ways of doing so?

DeepSeekv4+ will have image capability, they said so in their paper. GLM whenever they decide to. Both companies have they tech and for whatever reason haven't decide to prioritize it. Both of their OCR are SOTA among all OCR models closed or open. GLM demonstrated they know how to do this, with GLM-4.6V.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#167

Post by Schiendelman »

skeledrew wrote: post #138
Schiendelman wrote: post #37

Earlier quoted context omitted.

Sure, I'm not saying I, a software engineer, cannot do this. I'm saying it's significant onboarding friction . Unless this were a massive differentiator, people aren't going to be "talking about it" the way GP suggests!

The friction is near 0 when you can ask another LLM to set it up for you.

Here are a few frictions I see that reduce reach, in order:

1) You haven't even heard of it.

2) You have to know to look for both GLM and Z.ai. These are usually in the same article when reporting about GLM is written, at least.

3) You have to understand there could be a benefit in trying it; you have to want to try it for some reason. Their own blog post puts it below Opus 4.8 in each of the three benchmarks they used.

4) You have to figure out the pricing, which isn't obviously in the blog post...

5) When I first went to Z.ai, I got an error popup (not logged in): "You do not have permission to access this resource. Please contact your administrator for assistance." I am using a personal computer...

6) When I typed something in the resultant field and pressed enter, I got "Clear Current Chat? To start a new chat, your current conversation will be discarded. Sign in to save chats"

I think today's article helped with 1 and 2, which helps their top of funnel. But they're fighting a big uphill battle.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#168

Post by greenavocado »

kristopolous wrote: post #162
Certhas wrote: post #154

Earlier quoted context omitted.

None of these models come from universities, European or otherwise. Mistral is clearly currently not competing for Frontier Model. Whether this is due to a lack of VC Funds or a lack of technical ability or the former arising from the latter would be interesting to know. The top models are from startups. Among the FAANG only Google managed to get a Frontier model, and they litterally invented the architecture and hav…

I'm actually more curious about IBM. Their granite series appears to be nowhere close to competitive. They had Watson, remember, it won on jeopardy like 15 years ago? They've been at this for a long time Maybe it's good at something else?

Granite is OK for speech to text (ASR)

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#169

Post by rdsubhas »

Tiberium wrote: post #2

It seems to really be a nice step-up and is getting quite close to the frontier. I wish they'd start focusing on the reasoning efficiency now, though. I have a simple (relatively) test task to evaluate LLMs: writing a simple math evaluator library in Nim (it's about 400-600 lines total max), and GLM 5.2 (xhigh which maps to max effort) spent over 15 minutes (!) reasoning, spending about 45k tokens, before it finally…

As per stats in other comments, it is frontier, not close to frontier.
Post reply on HN