GLM-5.2 is the new leading open weights model on Artificial Analysis

Post by h14h » Wed, Jun 17, 2026, 12:57 PM UTC

Tiberium wrote: post #2

It seems to really be a nice step-up and is getting quite close to the frontier. I wish they'd start focusing on the reasoning efficiency now, though. I have a simple (relatively) test task to evaluate LLMs: writing a simple math evaluator library in Nim (it's about 400-600 lines total max), and GLM 5.2 (xhigh which maps to max effort) spent over 15 minutes (!) reasoning, spending about 45k tokens, before it finally…

Post by pjerem » Wed, Jun 17, 2026, 12:58 PM UTC

cmrdporcupine wrote: post #92

mrngld wrote: post #71

Artificial Analysis coding benchmark shows GLM5.1 on high pretty close to GPT5.5 xhigh in cost to run, with GPT5.5 on medium significantly less expensive. Compared to GPT5.5 medium GLM5.1xhigh is twice the cost and half the intelligence. They don't have GLM5.2 on there yet, but that'd a big gap to bridge. https://artificialanalysis.ai/agents/coding-agents?coding-ag... I thought I was "holding it wrong" until DeepSWE…

I gave GLM 5.2 a spin on openrouter yesterday and it was mostly fine but it racked up $5 in token use in 30 minutes of (relatively slow) work. It's easily 4x the cost of DeepSeek V4 but I didn't actually feel the results were that much better. I had GPT 5.5 in Codex review it after it was done and there was plenty of slop to go around. Having better luck with MiniMax M3, from a cost/benefit ratio.

Post by donohoe » Wed, Jun 17, 2026, 1:01 PM UTC

Schiendelman wrote: post #64

fc417fc802 wrote: post #61

Earlier quoted context omitted.

You're seriously suggesting that setting up opencode or tweaking your claude code config or etc is too much trouble to be worth saving $50 /mo? That's absurd. Doubly so when the audience in question is already using LLMs so ... just ask your existing LLM for help if it seems daunting.

I'm not just suggesting that, I'm trying to be crystal clear: it's a gap that probably cuts TAM by 95% or more. Most LLM users are not software engineers. Even those that are don't care enough to muck with their settings to try out a model. Keep in mind I'm not answering the question "Is this hard to install?" - I'm answering the question "Why aren't people talking about this?"

Post by smith7018 » Wed, Jun 17, 2026, 1:03 PM UTC

redox99 wrote: post #139

knollimar wrote: post #133

Earlier quoted context omitted.

Isn't it closer to sonnet?

Definitely opus level for coding.

Post by petesergeant » Wed, Jun 17, 2026, 1:06 PM UTC

tancop wrote: post #90

petesergeant wrote: post #62

Earlier quoted context omitted.

Unless you have genuine national security concerns, you’d be better off just negotiating a commercial agreement with privacy protections with a couple of existing vendors.

if you can afford the investment you get stable low costs for years with better security (at least if your cyber team is good). its even better in regulated industries where some vendors might add a premium for hipaa/soc/pci dss compliance to the point its a lot cheaper to self host. for a smaller business its not worth it and you should just use a hosted open model.