Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.2 is the new leading open weights model on Artificial Analysis

artificialanalysis.ai

Post reply on HN
Print view View original

251–260 of 476 posts

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#251

Post by marcus_cemes »

dr_dshiv wrote: post #216
marcus_cemes wrote: post #195

Earlier quoted context omitted.

To be honest, living in Switzerland and speaking with peers, we're just exhausted by the constant AI hype. For a lot of us, the fact that Europe isn't frantically trying to scrape the entire internet and every book in existence for the next massive model isn't a bad thing. The big players are doing their thing, like with the nuclear arms race. We regulate a lot, too much a lot of the time, but sometimes that trickles…

Sir, I would suggest that if Europe fails to be economically competitive, the downstream implications on European society will produce much worse outcomes than (for instance) data transparency… Doing things with ethical intentions does not necessarily produce outcomes that are beneficial for society at large.

I'm inclined to agree with you, but you could make the same argument for exploiting natural resources and the environment. I don't think it's being done right at the moment, and it does not seem to be benefiting people as much as certain companies.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#252

Post by scrollop »

kristopolous wrote: post #104

I have a script that ranks these based on codingindex from Artificial Analysis. All it does is pull a json from their main table page and parses it with the fields I care about (coding). There used to be a mailing list associated with it but eh ... there wasn't much interest. I use the script every day though. Current partial output score age size name 47.1 58 large Kimi K2.6 47.5 54 large DeepSeek V4 Pro (Reasoning,…

Would be interesting to see where gpt 5.5 pro extended is.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#255

Post by scrlk »

ComputerGuru wrote: post #239
scrlk wrote: post #108

Earlier quoted context omitted.

IME, unquantised -> FP8 is pretty much lossless. What matters more is having an unquantized KV cache - using an FP8 KV cache can result in a significant drop in quality.

Do infra providers reveal that level of implementation detail?

I've seen a few articles from providers talking about KV cache quantisation, but it's not something they explicitly point out like they do with weights.

So you could end up paying more for unquantised weights, only to get silently hit with a quantised KV cache...

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#256

Post by leemoore »

GLM 5.2 feels like Opus 4.6 level. I actually think 4.6 and GLM work better in practice than opus 4.7 or 4.8 as I find both of those more erratic and seem to randomly have a super dumb turn. That random bad turn I see doesn't seem to be hitting the benchmark scores but they make 4.7 and 4.8 very hard to use for me. GLM is more stable like opus 4.6

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#257

Post by lukewarm707 »

vadansky wrote: post #230
lukewarm707 wrote: post #179

Earlier quoted context omitted.

with open models you can get a subscription with privacy, at the same cost as codex. openai, google and anthropic subscriptions are not available with privacy. looking at the link there it's interesting that going from cursor cli to codex cli take gpt 5.5 from 7th to 3rd. but they didn't do open model in codex. so, hard to say it's for sure a model benchmark. maybe open models are just shit at swe agent harness...it'…

> with open models you can get a subscription with privacy Unless you're running it locally, aren't you just trusting some other entity?

correct, you are trusting another entity.

however the legal terms are different, openai reads your data. they store it for 30 days, but of course once it hits the disk you can keep as long as you like in a civil case like nyt v openai.

the same for google and anthropic. so, it's not always nice if someone is paid to read your data for safety. people upload sensitive matters, personal videos and so on.

i wouldn't prioritise it myself but you can also know that the data will all come out in discovery if you are in a legal issue. maybe that's not important, but people thought it did matter to give some protections to patient records, legal advice and therapy. you upload that to gpt and it goes into discovery.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#258

Post by cromka »

Schiendelman wrote: post #37
andai wrote: post #31

Earlier quoted context omitted.

But it just works with Claude Code? They have a guide on their website. https://docs.z.ai/devpack/tool/claude Here's my setup. I add this to my .bashrc export ZAI_API_KEY="your_key_here" alias claudez='ANTHROPIC_AUTH_TOKEN="$ZAI_API_KEY" ANTHROPIC_BASE_URL=" https://api.z.ai/api/anthropic " ANTHROPIC_DEFAULT_OPUS_MODEL="glm-5.2[1m]" ANTHROPIC_DEFAULT_SONNET_MODEL="glm-4.7" ANTHROPIC_DEFAULT_HAIKU_MODEL="glm-4.7" clau…

Sure, I'm not saying I, a software engineer, cannot do this. I'm saying it's significant onboarding friction . Unless this were a massive differentiator, people aren't going to be "talking about it" the way GP suggests!

> it's significant onboarding friction.

It's crazy that apparently writing software without knowing how to edit a single config file is normal now.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#259

Post by margalabargala »

duskdozer wrote: post #86
vitalyan123 wrote: post #80

Earlier quoted context omitted.

distillation of thinking models is not particularly effective - both "Open"AI and Misanthropic don't show you the real chain of thought, only its severely downscaled version. both do everything in their power to combat such outrageous copyright infringement, so the bulk of unethically scrapped data the Chinese have is from several generations ago.

>such outrageous copyright infringement Sarcasm, considering the source of their own training data?

Considering they called the company "Misanthropic", sarcasm is a safe bet.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#260

Post by esafak »

Tiberium wrote: post #2

It seems to really be a nice step-up and is getting quite close to the frontier. I wish they'd start focusing on the reasoning efficiency now, though. I have a simple (relatively) test task to evaluate LLMs: writing a simple math evaluator library in Nim (it's about 400-600 lines total max), and GLM 5.2 (xhigh which maps to max effort) spent over 15 minutes (!) reasoning, spending about 45k tokens, before it finally…

I agree. I've noticed that it is quite smart but it has a tendency to doubt itself and overthink. I monitor its internal dialogue and prod it when it does this. They need to optimize the chain of thought early stopping.
Post reply on HN