Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM 5.2 Is Out

twitter.com

Post reply on HN
Print view View original

131–140 of 544 posts

Re: GLM 5.2 Is Out

#131

Post by mirekrusin »

3836293648 wrote: post #127
kamranjon wrote: post #120

Crossing fingers for a 5.2 flash release - it’s been a while but I still feel like 4.7 flash is one of the strongest local coding models

Really? I had a terrible experience with 4.7-flash. Qwen-3.5 is still the best local model for me. (3.6 pushed VRAM usage just out of 24GB and then you're not using a consumer GPU any more)

There were bugs at the beginning (imho worst ones where it kind of works but sucks), you should re-try with latest llama.cpp/quants/whatever you're using.

Stuff like repeated nonsense, endless ???????? output, bogus code, loops after a few hundred tokens, working fine for the first few hundred tokens, then getting stuck in a loop, gibberish output (with flash attention) on after second or third prompt, flash attention failing with kv-cache quantization on long prompts, chat template / jinja / tool-calling problems, inconsistent tool calls in agentic coding, mixed-language nonsense and repeated fragments (corrupted llama-server state / grammar-trigger loop), partial cpu offload/fit problems (it would exit reasoning, start coding, interrupt functions after a few lines, then rewrite snippets repeatedly) etc were all unintended and were fixed.

Re: GLM 5.2 Is Out

#132

Post by zozbot234 »

anon373839 wrote: post #125
wgd wrote: post #118

Earlier quoted context omitted.

The GLM-5 series is 744B-A40B. This is not a local model for any reasonable definition of local, but it's an open model which means (once they upload the weights in a week or so) there will be a dozen third-party inference providers competing on price per token.

> This is not a local model for any reasonable definition of local That's true for now. I am hopeful that once the hardware markets have recovered from OpenAI's sabotage, we will see more hardware dedicated to local inference that can handle these big models. Also, I'm thinking about the unique MoE routing that Apple is using with their new Apple Foundation Model. The model is trained and architected so that experts…

Normally, experts are picked for every layer not just every token. But there are plausible ways of getting around that bottleneck while streaming if you can batch many inferences together. Still, the Apple approach of swapping the experts only rarely is interesting, though it likely degrades the model a lot.

Re: GLM 5.2 Is Out

#133

Post by himata4113 »

thewebguyd wrote: post #87
khalic wrote: post #61

Given the US government’s latest stunt with Fable, this is looking more and more like the future. Can’t rely on strategic products if they’re gated by capricious actors. Open weight models are basically immune to that

> Open weight models are basically immune to that Somewhat. The US Gov can make it illegal to transact with, download, use, etc. foreign open weight models. Of course, enforcement will be difficult for individuals (businesses will comply by default, and they would all be pulled off Github and other US based hosting locations if they went the sanctions route). But, we are also quickly going down the road of frightenin…

I doubt it, you can easily distill it into "made in USA" model. They're MIT after all.

A lot more expensive thought, but the added benefit is that you can train on your companies data improving performance of the model.

Re: GLM 5.2 Is Out

#135

Post by krelian »

oooyay wrote: post #83
easygenes wrote: post #75

Announcement from the founder of Z.ai: “ GLM-5.2 is Fully Open, Frontier Intelligence Belongs to Everyone Today, the sudden restriction of certain frontier models is deeply regrettable. At a time when access to frontier models is abruptly cut off for non-technical reasons, we are even more convinced of one thing: science should be global. The path to AGI (Artificial General Intelligence) must never be enclosed by hig…

[flagged]

What do you expect them to do instead?

Re: GLM 5.2 Is Out

#136

Post by alexwwang »

oooyay wrote: post #83
easygenes wrote: post #75

Announcement from the founder of Z.ai: “ GLM-5.2 is Fully Open, Frontier Intelligence Belongs to Everyone Today, the sudden restriction of certain frontier models is deeply regrettable. At a time when access to frontier models is abruptly cut off for non-technical reasons, we are even more convinced of one thing: science should be global. The path to AGI (Artificial General Intelligence) must never be enclosed by hig…

[flagged]

I think maybe it’s a tool and it’s up to you to make use of tools to try to let more Chinese people know and convince them to believe your idea. Don’t blame a tool but make proper use of it to make a better world.

Re: GLM 5.2 Is Out

#137

Post by ghostpepper »

3836293648 wrote: post #127
kamranjon wrote: post #120

Crossing fingers for a 5.2 flash release - it’s been a while but I still feel like 4.7 flash is one of the strongest local coding models

Really? I had a terrible experience with 4.7-flash. Qwen-3.5 is still the best local model for me. (3.6 pushed VRAM usage just out of 24GB and then you're not using a consumer GPU any more)

which quants of 3.5 vs 3.6 did you compare? I guess you're saying that whatever quant you were using, going one lower was worse? ie. 3.5 Q6_K at 22.5GB versus 3.5 Q6_K at 22.9GB?

Re: GLM 5.2 Is Out

#138

Post by wgd »

zschallz wrote: post #95

Curious what people's experience is with these models. Anecdotally I tried these out earlier in the year and found it struggled with pretty basic full-stack coding I was doing, when Sonnet 4.6 and Haiku 4.5 didn't break a sweat. Was hoping to use it while my Claude usage was resetting but was disappointed.

I've got a GLM subscription (mostly because I like supporting open model makers, pretty sure my monthly usage is so low that pay-per-token would be more cost effective), so I generally use GLM-5.1 for any personal projects and I use Opus at work.

To be entirely honest I haven't noticed much of a capability gap between the two for the sorts of things I ask of an AI agent. Maybe Opus is _slightly_ smarter or slightly better at long-running tasks but the difference is slim enough it could just be a placebo from the Claude branding / hype.

I'm looking forward to giving GLM-5.2 a spin sometime soon and seeing how it stacks up. If nothing else 1M context is a great improvement, feels like between DeepSeek v4, then MiniMax M3, and now GLM-5.2 adding it 1M is rapidly becoming "table stakes" for agentic models.

Re: GLM 5.2 Is Out

#139

Post by jubilanti »

phainopepla2 wrote: post #113
alecco wrote: post #99

Earlier quoted context omitted.

> GLM-5.2 is Fully Open Is this just open weights or also open source/data?

Have any major open weight models been "open data"? Wouldn't that entail distributing vast amounts of copyrighted data?

Olmo from AllenAI has been releasing their full pipelines including data [1]. A lot of it is just repackaged and resampled dumps from copyrighted data that has long been publicly available as dumps: Common Crawl, arxiv, Wikipedia, StackExchange, reddit --- all of which are presumably copyrighted with different licenses. Go in Huggingface and you can find massive multi TB data dumps used for pre training.

It is just as legal as when Uber and AirBNB were running illegal taxis and hotels during their growth phase. I'm just waiting for some corporate IP law firm to learn about Huggingface.

[1] https://huggingface.co/datasets/allenai/dolma3_pool

Re: GLM 5.2 Is Out

#140

Post by ebbi »

oooyay wrote: post #83
easygenes wrote: post #75

Announcement from the founder of Z.ai: “ GLM-5.2 is Fully Open, Frontier Intelligence Belongs to Everyone Today, the sudden restriction of certain frontier models is deeply regrettable. At a time when access to frontier models is abruptly cut off for non-technical reasons, we are even more convinced of one thing: science should be global. The path to AGI (Artificial General Intelligence) must never be enclosed by hig…

[flagged]

As opposed to the censured responses about Israel?

Or if not censured in some models, it's a very different tone compared to asking it about any other country and its violent actions (past or present).

Post reply on HN