Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.2 is the new leading open weights model on Artificial Analysis

artificialanalysis.ai

Post reply on HN
Print view View original

431–440 of 476 posts

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#431

Post by muyuu »

sterlind wrote: post #404
muyuu wrote: post #399

Earlier quoted context omitted.

you need 8 x 96GB Blackwell or equivalent so around US$150k which is Small/Medium-Enterprise territory already, but who knows when it will hit "reasonable" home consumer territory I think there's hope future generations of unified memory machines may get this sort of memory availability when new fabs open in then next couple of years and then ramp up production for a few years afterwards - that makes ~2030s credible…

there are cheaper ways to do it. not like, consumer-cheap, but I'm setting up a rig for 80% cheaper than that. I'm a tad worried about triggering a run on the particular hardware I'm buying though so I'll leave it vague here, but hit me up on Discord if you're curious.

But at what kind of speed? We're aiming at some speed that would negate the point of even using an off-site provider.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#432

Post by mikestorrent »

majormajor wrote: post #425
chartpath wrote: post #383

Earlier quoted context omitted.

Are there any indications that this will be possible? Consumer hardware will continue getting better but I can't see 512GB RAM in a MacBook Pro any time soon. I'm hoping linear attention techniques plus MoE will make breakthroughs in size/compression and throughput.

In the last ten years laptop memory footprints have, what, doubled at the low end? Smallest MacBook Pro in 2016 was 8GB, smallest is 16GB today? Max I think has gone up 8x meanwhile, 16 to 128? I wonder if there's a bit of a chicken-and-egg issue where there wasn't much that demanded 10x the RAM, so there wasn't much pressure to develop more or increase production to support it at consumer prices. There's wayyyyyyy m…

The new Macbook Neo is 8GB. I think that if we are lucky, the huge RAM demand right now means new factory buildouts which eventually means more supply and prices go back down, and capacity begins to go up. This level of demand was just not anticipated by anyone.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#433

Post by Alifatisk »

dizhn wrote: post #407
Alifatisk wrote: post #228

Earlier quoted context omitted.

Where can I read more about the coming 3mil GLM 5.2?

I meant the credits are included in the application you download from there. Install, log in (via google) and You'll get glm 5.2 + turbo. Mine actually either got replenished or they are not checking by login because they are full after installing at a second desktop.

Oh, cool

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#434

Post by gateonai »

Tiberium wrote: post #2

It seems to really be a nice step-up and is getting quite close to the frontier. I wish they'd start focusing on the reasoning efficiency now, though. I have a simple (relatively) test task to evaluate LLMs: writing a simple math evaluator library in Nim (it's about 400-600 lines total max), and GLM 5.2 (xhigh which maps to max effort) spent over 15 minutes (!) reasoning, spending about 45k tokens, before it finally…

[flagged]

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#435

Post by woctordho »

mirekrusin wrote: post #361
vitalyan123 wrote: post #80

Earlier quoted context omitted.

distillation of thinking models is not particularly effective - both "Open"AI and Misanthropic don't show you the real chain of thought, only its severely downscaled version. both do everything in their power to combat such outrageous copyright infringement, so the bulk of unethically scrapped data the Chinese have is from several generations ago.

I don’t understand why there isn’t public dataset for reasoning that can be improved by humans/llms like Wikipedia (ie with auto judging contributions etc).

There is already a lot of effort to collect agent traces including reasonings, e.g. see the recent discussion: https://old.reddit.com/r/LocalLLaMA/comments/1u795pb/donate_...

We've been developing DataClaw for this: https://github.com/peteromallet/dataclaw

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#436

Post by woctordho »

ComputerGuru wrote: post #235
vitalyan123 wrote: post #80

Earlier quoted context omitted.

distillation of thinking models is not particularly effective - both "Open"AI and Misanthropic don't show you the real chain of thought, only its severely downscaled version. both do everything in their power to combat such outrageous copyright infringement, so the bulk of unethically scrapped data the Chinese have is from several generations ago.

Supposedly there are “jailbreaks” that expose considerably more of the thinking traces.

Simple trick: Use an agentic tool like Pi or OpenCode that allows you to switch models. First do some chats with DeepSeek or GLM who shows full thinking traces, then switch to Claude or GPT and it's more likely to show full thinking traces.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#438

Post by stymaar »

jgalt212 wrote: post #319
stymaar wrote: post #119

Earlier quoted context omitted.

> No models are subsidised We have no proof in either direction, it's not like we had access to their financial numbers in details. And the pricing itself muddies the water, as input tokens that are already in the KV cache are practically free for the provider, whereas other tokens are expensive. So they could still make money overall thanks to people having multi-turn conversation (and as such, paying multiple times…

> as input tokens that are already in the KV cache are practically free for the provider, not at today's RAM prices.

RAM price don't change anything. You can't fit an infinity of tokens in the KV cache, but the ones that are in there when a user request them are still practically free.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#439

Post by harshit119 »

matheusmoreira wrote: post #359
benjiro29 wrote: post #59

Earlier quoted context omitted.

GLM 5.2 Max = Opus 4.8 Max in thinking behavior. The thinking chain is so similar, and so is the amount of token usage on the output. If you want reasonable token usage, you need to run it GLM 5.2 at High. There is little drop in quality from Max to High (for most tasks). And it cuts token usage by 2 a 2.5x. GLM 5.2, Max is really something you only need for complex tasks. In essence, GLM 5.2 is Opus 4.8 its little b…

> GLM 5.2 Max = Opus 4.8 Max in thinking behavior This is insane! I can't wait until technology progresses to the point we can run these things on consumer hardware!

This is quite evident for personal AI but general intelligence with current scaling laws and how model keep getting better with more number of parameters, certainly the path does not converge. Personal AI is more deprived of context today than quality of token. Having a on-system knowledge base paired with Gemma works well to large extend.

Re: GLM-5.2 is the new leading open weights model on Artificial Analysis

#440

Post by slagfart »

ttul wrote: post #171
mrngld wrote: post #71

Artificial Analysis coding benchmark shows GLM5.1 on high pretty close to GPT5.5 xhigh in cost to run, with GPT5.5 on medium significantly less expensive. Compared to GPT5.5 medium GLM5.1xhigh is twice the cost and half the intelligence. They don't have GLM5.2 on there yet, but that'd a big gap to bridge. https://artificialanalysis.ai/agents/coding-agents?coding-ag... I thought I was "holding it wrong" until DeepSWE…

DeepSWE “feels” like the right benchmark in comparison to Artificial Analysis indices and other coding benchmarks. And by their metrics, GPT-5.5 is still king in token efficiency, speed, and overall intelligence per dollar. https://deepswe.datacurve.ai/ Fable 5 is cool and all, but we have not yet seen GPT-5.6.

GLM5.2 isn't even on this benchmark
Post reply on HN