Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5: Targeting complex systems engineering and long-horizon agentic tasks

z.ai

Post reply on HN
Print view View original

81–90 of 540 posts

Re: GLM-5: Targeting complex systems engineering and long-horizon agentic tasks

#81

Post by Aurornis »

flaviolivolsi wrote: post #57
btbuildem wrote: post #36

Earlier quoted context omitted.

> doesn't make financial sense to self-host I guess that's debatable. I regularly run out of quota on my claude max subscription. When that happens, I can sort of kind of get by with my modest setup (2x RTX3090) and quantized Qwen3. And this does not even account for privacy and availability. I'm in Canada, and as the US is slowly consumed by its spiral of self-destruction, I fully expect at some point a digital iron…

How does your quantized Qwen3 compares in code quality to Opus?

Not the person you’re responding to, but my experience with models up through Qwen3-coder-next is that they’re not even close.

They can do a lot of simple tasks in common frameworks well. Doing anything beyond basic work will just burn tokens for hours while you review and reject code.

Re: GLM-5: Targeting complex systems engineering and long-horizon agentic tasks

#82

Post by wongarsu »

mythz wrote: post #58
btbuildem wrote: post #36

Earlier quoted context omitted.

> doesn't make financial sense to self-host I guess that's debatable. I regularly run out of quota on my claude max subscription. When that happens, I can sort of kind of get by with my modest setup (2x RTX3090) and quantized Qwen3. And this does not even account for privacy and availability. I'm in Canada, and as the US is slowly consumed by its spiral of self-destruction, I fully expect at some point a digital iron…

Did the napkin math on M3 Ultra ROI when DeepSeek V3 launched: at $0.70/2M tokens and 30 tps, a $10K M3 Ultra would take ~30 years of non-stop inference to break even - without even factoring in electricity. Clearly people aren't self-hosting to save money. I've got a lite GLM sub $72/yr which would require 138 years to burn through the $10K M3 Ultra sticker price. Even GLM's highest cost Max tier (20x lite) at $720/…

And it's worth noting that you can get DeepSeek at those prices from DeepSeek (Chinese), DeepInfra (US with Bulgarian founder), NovitaAI (US), AtlasCloud (US with Chinese founder), ParaSail (US), etc. There is no shortage of companies offering inference, with varying levels of trustworthiness, certificates and promises around (lack of) data retention. You just have to pick one you trust

Re: GLM-5: Targeting complex systems engineering and long-horizon agentic tasks

#83

Post by 7thpower »

btbuildem wrote: post #36
mythz wrote: post #5

It's looking like we'll have Chinese OSS to thank for being able to host our own intelligence, free from the whims of proprietary megacorps. I know it doesn't make financial sense to self-host given how cheap OSS inference APIs are now, but it's comforting not being beholden to anyone or requiring a persistent internet connection for on-premise intelligence. Didn't expect to go back to macOS but they're basically the…

> doesn't make financial sense to self-host I guess that's debatable. I regularly run out of quota on my claude max subscription. When that happens, I can sort of kind of get by with my modest setup (2x RTX3090) and quantized Qwen3. And this does not even account for privacy and availability. I'm in Canada, and as the US is slowly consumed by its spiral of self-destruction, I fully expect at some point a digital iron…

Unless you already had those cards, it probably still doesn’t make sense from a purely financial perspective unless you have other things you’re discounting for.

Doesn’t mean you shouldn’t do it though.

Re: GLM-5: Targeting complex systems engineering and long-horizon agentic tasks

#85

Post by esafak »

jannniii wrote: post #31
NiloCK wrote: post #14

Earlier quoted context omitted.

> Didn't expect to go back to macOS but their basically the only feasible consumer option for running large models locally. I presume here you are referring to running on the device in your lap. How about a headless linux inference box in the closet / basement? Return of the home network!

Indeed and I got two words for you: Strix Halo

How much memory does yours have, what are you running on it, with what cache size, and how fast?

Re: GLM-5: Targeting complex systems engineering and long-horizon agentic tasks

#86

Post by thebruce87m »

nialv7 wrote: post #44
mythz wrote: post #5

It's looking like we'll have Chinese OSS to thank for being able to host our own intelligence, free from the whims of proprietary megacorps. I know it doesn't make financial sense to self-host given how cheap OSS inference APIs are now, but it's comforting not being beholden to anyone or requiring a persistent internet connection for on-premise intelligence. Didn't expect to go back to macOS but they're basically the…

> Didn't expect to go back to macOS but their basically the only feasible consumer option for running large models locally. Framework Desktop! Half the memory bandwidth of M4 Max, but much cheaper.

Does that equate to half the speed in terms of output? Any recommended benchmarks to look at?

Re: GLM-5: Targeting complex systems engineering and long-horizon agentic tasks

#88

Post by roywiggins »

throwaw12 wrote: post #73
CodeCompost wrote: post #68

[flagged]

As I promised earlier: https://news.ycombinator.com/item?id=46781777 "I will save this for the future, when people complain about Chinese open models and tell me: But this Chinese LLM doesn't respond to question about Tianmen square." Please stop using Tianmen question as an example to evaluate the company or their models: https://news.ycombinator.com/item?id=46779809

That's just whataboutism. Why shouldn't people talk about the various ideological stances embedded in different LLMs?
Post reply on HN