Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.2 is the new leading open weights model on Artificial Analysis

artificialanalysis.ai

Post reply on HN
Print view View original

231–240 of 476 posts

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#231

Post by robertkarl »

vorticalbox wrote: post #29
Tiberium wrote: post #2

It seems to really be a nice step-up and is getting quite close to the frontier. I wish they'd start focusing on the reasoning efficiency now, though. I have a simple (relatively) test task to evaluate LLMs: writing a simple math evaluator library in Nim (it's about 400-600 lines total max), and GLM 5.2 (xhigh which maps to max effort) spent over 15 minutes (!) reasoning, spending about 45k tokens, before it finally…

This is a problem I find with opus is will spend so long thinking then going “but wait what if” To point where I stop it and simple tell it to “start writing code you can work it out as you go along” Seems writers block also effects LLM

https://arxiv.org/abs/2606.00206

In this paper they nerf an LLMs ability to emit waffling thinking tokens like "wait", "but", "alternatively", and the models (they're old, small models in the paper) terminate reasoning faster and perform better. I bet Anthropic is tuning this on their backend.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#232

Post by JKCalhoun »

applicative wrote: post #206
tcp_handshaker wrote: post #137

Earlier quoted context omitted.

Short comments... - GPT 5.5 consistently the best, an opinion who gets me constant downvotes here by the Anthropic Marketeer strike force... - China is going to eat the US lunch on AI - What have European universities and companies been doing? Its like if, on a parallel past/future, Nikola Tesla and Edison would have created flying Cyberpunk machines, while Europeans researchers, would be getting together to request…

> China is going to eat the US lunch on AI They will forever have superior weights?

I would imagine it will be a fundamental breakthrough, not weights alone, that are going to usher in the next generation of AI. Perhaps China will in fact make that breakthrough. They certainly seem to have a lot of eyeballs in the field right now.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#233

Post by Quarrel »

Certhas wrote: post #154
tcp_handshaker wrote: post #137

Earlier quoted context omitted.

Short comments... - GPT 5.5 consistently the best, an opinion who gets me constant downvotes here by the Anthropic Marketeer strike force... - China is going to eat the US lunch on AI - What have European universities and companies been doing? Its like if, on a parallel past/future, Nikola Tesla and Edison would have created flying Cyberpunk machines, while Europeans researchers, would be getting together to request…

None of these models come from universities, European or otherwise. Mistral is clearly currently not competing for Frontier Model. Whether this is due to a lack of VC Funds or a lack of technical ability or the former arising from the latter would be interesting to know. The top models are from startups. Among the FAANG only Google managed to get a Frontier model, and they litterally invented the architecture and hav…

Mistral have moved to actually trying to make money, and been relatively successful; at least if we lived in a normal world.

They've got a heap of contractors working to help industry adopt LLMs. It is just classic consulting work, and they'd look like a really great company if we weren't comparing them to literal $2T+ companies losing money hand-over-fist...

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#234

Post by ac29 »

segmondy wrote: post #146
kissgyorgy wrote: post #72

I tried it today through Openrouter and the API is atrocious. I got multiple rate limit and random errors every turn. Somebody wrote [1]; "I am never touching Minimax or GLM again. Their APIs had constant outages and I had to restart my runs multiple times — after burning money on the runs that failed midway." and I 100% agree. The model might be good, but if the API is so bad, it's effectively useless. [1]: https://…

The entire point of this post is that it's open weights, you can run it yourself and don't have to deal with the API issues. You really do have that choice.

You could subscribe to Anthropic/OpenAI for the rest of your life for the cost it would take to host GLM5.2 locally - you need 1.5TB of VRAM just for the weights

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#235

Post by ComputerGuru »

vitalyan123 wrote: post #80
benjiro29 wrote: post #59

Earlier quoted context omitted.

GLM 5.2 Max = Opus 4.8 Max in thinking behavior. The thinking chain is so similar, and so is the amount of token usage on the output. If you want reasonable token usage, you need to run it GLM 5.2 at High. There is little drop in quality from Max to High (for most tasks). And it cuts token usage by 2 a 2.5x. GLM 5.2, Max is really something you only need for complex tasks. In essence, GLM 5.2 is Opus 4.8 its little b…

distillation of thinking models is not particularly effective - both "Open"AI and Misanthropic don't show you the real chain of thought, only its severely downscaled version. both do everything in their power to combat such outrageous copyright infringement, so the bulk of unethically scrapped data the Chinese have is from several generations ago.

Supposedly there are “jailbreaks” that expose considerably more of the thinking traces.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#236

Post by ramraj07 »

fc417fc802 wrote: post #61
Schiendelman wrote: post #37

Earlier quoted context omitted.

Sure, I'm not saying I, a software engineer, cannot do this. I'm saying it's significant onboarding friction . Unless this were a massive differentiator, people aren't going to be "talking about it" the way GP suggests!

You're seriously suggesting that setting up opencode or tweaking your claude code config or etc is too much trouble to be worth saving $50 /mo? That's absurd. Doubly so when the audience in question is already using LLMs so ... just ask your existing LLM for help if it seems daunting.

Thats not absurd. Do you know what software engineers make? Do you know what a Starbucks coffee costs? 50 bucks is nothing for someone in that life.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#239

Post by ComputerGuru »

scrlk wrote: post #108
stanac wrote: post #26

Earlier quoted context omitted.

> Some are even offering API rates at 3x lower than the official ZAI api rates Looking at openrouter [1], some of the cheaper offerings are for quantized models. Not sure how much intelligence is lost in quantization. And they are not 3 times cheaper. Where did you find 3x lower prices for APIs? I am considering skipping open router and using them directly for that price. edit: I see, croft [2] 8bit for $0.50/$0.08/$…

IME, unquantised -> FP8 is pretty much lossless. What matters more is having an unquantized KV cache - using an FP8 KV cache can result in a significant drop in quality.

Do infra providers reveal that level of implementation detail?

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#240

Post by bel8 »

Alifatisk wrote: post #221
bel8 wrote: post #183

Earlier quoted context omitted.

I beg to differ. I replaced a $40/mo GitHub Copilot subscription where I used Opus 4.6 and GPT 5.5 with a $10/mo opencode Go plan where I use mostly DeepSeek V4 Flash and testing MiMo 2.5. I work on mid-sized projects currently (200k to 1kk lines of code).

> 1kk lines of code Isn't that a million?

Yep. I consider up to a million lines of code as mid-sized.

When I worked in banking, the codebases were often larger than a million.

Post reply on HN