Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.2 is the new leading open weights model on Artificial Analysis

artificialanalysis.ai

Post reply on HN
Print view View original

131–140 of 476 posts

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#131

Post by kristopolous »

alecco wrote: post #113
kristopolous wrote: post #104

I have a script that ranks these based on codingindex from Artificial Analysis. All it does is pull a json from their main table page and parses it with the fields I care about (coding). There used to be a mailing list associated with it but eh ... there wasn't much interest. I use the script every day though. Current partial output score age size name 47.1 58 large Kimi K2.6 47.5 54 large DeepSeek V4 Pro (Reasoning,…

Consider using decrementing score order (best on top)

then I'd have to scroll up over 500 lines after running it every time to see what I care about.

But if that's your thing, here you go: https://github.com/day50-dev/aa-eval-email/commit/1853be6461...

add an argument (any argument) and it will be sorted as your specified. It just works as a toggle flipping the order ... so literally any string will do.

The original link has been updated accordingly with the new code.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#132

Post by spwa4 »

alecco wrote: post #113
kristopolous wrote: post #104

I have a script that ranks these based on codingindex from Artificial Analysis. All it does is pull a json from their main table page and parses it with the fields I care about (coding). There used to be a mailing list associated with it but eh ... there wasn't much interest. I use the script every day though. Current partial output score age size name 47.1 58 large Kimi K2.6 47.5 54 large DeepSeek V4 Pro (Reasoning,…

Consider using decrementing score order (best on top)

[dead]

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#133

Post by knollimar »

unrvl22 wrote: post #4

Why aren't more people talking about this? It's literally Opus 4.7 quality stupid prices. I know providers who are offering this at unlimited tokens for $50 a month. Some are even offering API rates at 3x lower than the official ZAI api rates which are already like 10x cheaper than Opus. (Crof and Umans btw) This is a huge blow to Anthropic/OpenAI/Google and a massive win for the rest of the world. The official API p…

Isn't it closer to sonnet?

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#134

Post by Mashimo »

JustSkyfall wrote: post #118

The problem with these benchmarks is that the Chinese models tend to be incredible on paper, and absolutely terrible in practice :/

I have used GLM since version 4.8 I think and do enjoy using them. More then other models like Kimi or Deepseek. Though only tested them on smaller private projects.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#135

Post by simonw »

_pdp_ wrote: post #116
simonw wrote: post #110

I was surprised that GLM 5.1/5.2 are not vision models - they are text input only. That's actually pretty uncommon these days. All of the OpenAI/Anthropic/Gemini models accept images, and so do the other leading open weight families - Gemma 4, Qwen 3.6, Kimi 2.x. In GLM's case image input would be useful because it's a model that scores very highly for tasks like web design, but without image input it can't take a sc…

I don't see this being such a big gap. There are some use-cases for sure but apart from UX/UI work it is not really needed. Besides, none of the frontier models can replicate actual images - the can approximate at least in my own experience.

One of my tests for a new model is dumping in a screenshot of a web page and seeing if it can recreate it from scratch in HTML and CSS.

Even the local models I run on my Mac are getting surprisingly good at that now.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#137

Post by tcp_handshaker »

papersail wrote: post #130
kristopolous wrote: post #104

I have a script that ranks these based on codingindex from Artificial Analysis. All it does is pull a json from their main table page and parses it with the fields I care about (coding). There used to be a mailing list associated with it but eh ... there wasn't much interest. I use the script every day though. Current partial output score age size name 47.1 58 large Kimi K2.6 47.5 54 large DeepSeek V4 Pro (Reasoning,…

score age size name 62.0 8 - Claude Fable 5 (Adaptive Reasoning, Max Effort, Opus 4.8 Fallback) 59.1 55 - GPT-5.5 (xhigh) 58.5 55 - GPT-5.5 (high) 57.2 104 - GPT-5.4 (xhigh) 56.7 20 - Claude Opus 4.8 (Adaptive Reasoning, Max Effort) 56.2 55 - GPT-5.5 (medium) 55.5 118 - Gemini 3.1 Pro Preview 53.1 132 - GPT-5.3 Codex (xhigh) 53.1 62 - Claude Opus 4.7 (Non-reasoning, High Effort) 52.5 62 - Claude Opus 4.7 (Adaptive Re…

Short comments...

- GPT 5.5 consistently the best, an opinion who gets me constant downvotes here by the Anthropic Marketeer strike force...

- China is going to eat the US lunch on AI

- What have European universities and companies been doing? Its like if, on a parallel past/future, Nikola Tesla and Edison would have created flying Cyberpunk machines, while Europeans researchers, would be getting together to request EU funds, for investigation on how to breed faster horses.

- If Zuckerberg could be fired, after spending a total of $235 billion on AI and having NOTHING to show for...should he be fired?

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#138

Post by skeledrew »

Schiendelman wrote: post #37
andai wrote: post #31

Earlier quoted context omitted.

But it just works with Claude Code? They have a guide on their website. https://docs.z.ai/devpack/tool/claude Here's my setup. I add this to my .bashrc export ZAI_API_KEY="your_key_here" alias claudez='ANTHROPIC_AUTH_TOKEN="$ZAI_API_KEY" ANTHROPIC_BASE_URL=" https://api.z.ai/api/anthropic " ANTHROPIC_DEFAULT_OPUS_MODEL="glm-5.2[1m]" ANTHROPIC_DEFAULT_SONNET_MODEL="glm-4.7" ANTHROPIC_DEFAULT_HAIKU_MODEL="glm-4.7" clau…

Sure, I'm not saying I, a software engineer, cannot do this. I'm saying it's significant onboarding friction . Unless this were a massive differentiator, people aren't going to be "talking about it" the way GP suggests!

The friction is near 0 when you can ask another LLM to set it up for you.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#139

Post by redox99 »

knollimar wrote: post #133
unrvl22 wrote: post #4

Why aren't more people talking about this? It's literally Opus 4.7 quality stupid prices. I know providers who are offering this at unlimited tokens for $50 a month. Some are even offering API rates at 3x lower than the official ZAI api rates which are already like 10x cheaper than Opus. (Crof and Umans btw) This is a huge blow to Anthropic/OpenAI/Google and a massive win for the rest of the world. The official API p…

Isn't it closer to sonnet?

Definitely opus level for coding.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#140

Post by xstas1 »

giancarlostoro wrote: post #112
vorticalbox wrote: post #29

Earlier quoted context omitted.

This is a problem I find with opus is will spend so long thinking then going “but wait what if” To point where I stop it and simple tell it to “start writing code you can work it out as you go along” Seems writers block also effects LLM

I usually have Claude build a plan first, then I put it into an XML file it updates with phases, usually we talk about some of those tasks, and then once its good and I like it, I have Claude implement the plan. Another thing I tell Claude to do is to not guess, but look at documentation, it messes up a lot less, might use some tokens reading docs, but at least it has a higher success rate code wise.

XML??
Post reply on HN