Live data from Hacker News

GLM-5.1: Towards Long-Horizon Tasks

z.ai

61–70 of 285 posts

Re: GLM-5.1: Towards Long-Horizon Tasks

#61

I find the "8 hour Linux Desktop" bit disingenuous, in the fine print it's a browser page: > "build a Linux-style desktop environment as a web application" They claim "50 applications from scratch", but "Browser" and a bunch of the other apps are likely all elements. We all know that building a spec-compliant browser alone is a herculean task.

It is a big claim without the source and prompting.

Re: GLM-5.1: Towards Long-Horizon Tasks

#62

Earlier quoted context omitted.

I'm on their pro plan and I respectfully disagree - it's genuinely excellent with GLM 5.1 so long as you remember to /compact once it hits around 100k tokens. At that point it's pretty much broken and entirely unusable, but if you keep context under about 100k it's genuinely on par with Opus for me, and in some ways it's arguably better.

100k tokens it's basically nothing these days. Claude Opus 4.6M with 1M context windows is just a different ball game

The cost per message increases with context while quality decreases so it’s still generally good to practice strategic context engineering. Even with cross-repo changes on enterprise systems, it’s uncommon to need more than 100k (unless I’m using playwright mcp for testing).

Re: GLM-5.1: Towards Long-Horizon Tasks

#63

Earlier quoted context omitted.

Hmm, three spam comments posted within 9 minutes of each other. The accounts were created 15 minutes ago, 51 days ago, and 3 months ago. Interesting. Hopefully these aren't bots created by Z.AI because GLM doesn't need fake engagement.

Z.ai Discord is filled to the brim with people experiencing capacity issues. I had to cancel my subscription with Z.ai because the service was totally unusable. Their Discord is a graveyard of failures. I switched to Alibaba Cloud for GLM but now they hiked their coding plan to $50 a month which is 2.5x more expensive than ChatGPT Plus. Totally insane.

Everyone has started either hiking their prices or limiting the tokens, gravy train is over. Glad we have open models that we can host; Sad RAM is so expensive..

Re: GLM-5.1: Towards Long-Horizon Tasks

#64
post #20

To be honest I am a bit sad as, glm5.1 is producing mich better typescript than opus or codex imo, but no matter what it does sometimes go into shizo mode at some point over longer contexts. Not always tho I have had multiple session go over 200k and be fine.

I honestly still hold onto habits from earlier days of Claude & Codex usage and tend to wipe / compact my context frequently. I don't trust the era of big giant contexts, frankly, even on the frontier models.

Re: GLM-5.1: Towards Long-Horizon Tasks

#65

Comments here seem to be talking like they've used this model for longer than a few hours -- is this true, or are y'all just sharing your initial thoughts?

My local tennis court's reservation website was broken and I couldn't cancel a reservation, and I asked GLM-5.1 if it can figure out the API. Five minutes later, I check and it had found a /cancel.php URL that accepted an ID but the ID wasn't exposed anywhere, so it found and was exploiting a blind SQL injection vulnerability to find my reservation ID.

Overeager, but I was really really impressed.

Re: GLM-5.1: Towards Long-Horizon Tasks

#67
post #8

It's an okay model. My biggest issue using GLM 5.1 in OpenCode is that it loses coherency over longer contexts. When you crest 128k tokens, there's a high chance that the model will start spouting gibberish until you compact the history. For short-term bugfixing and tweaks though, it does about what I'd expect from Sonnet for a pretty low price.

Yes, this is frustrating, but it doesn’t occur in CC. I run the conversation logs through an agent and opencode source, and it identified an issue in the reasoning implementation of opencode for Zai models. Consequently, I ceased my research and opted to use CC instead.

Re: GLM-5.1: Towards Long-Horizon Tasks

#68
post #48

GLM-5.0 is the real deal as far as open source models go. In our internal benchmarks it consistently outperforms other open source models, and was on par with things like GPT-5.2. Note that we don't use it for coding - we use it for more fuzzy tasks.

I am working on a large scale dataset for producing agent traces for Python cython conversion with tooling, and it is second only to gemini pro 3.1 in acceptance rates (16% vs 26%).

Mid-sized models like gpt-oss minimax and qwen3.5 122b are around 6%, and gemma4 31b around 7% (but much slower).

I haven’t tried Opus or ChatGPT due to high costs on openrouter for this application.

Re: GLM-5.1: Towards Long-Horizon Tasks

#69

Earlier quoted context omitted.

I'm on their pro plan and I respectfully disagree - it's genuinely excellent with GLM 5.1 so long as you remember to /compact once it hits around 100k tokens. At that point it's pretty much broken and entirely unusable, but if you keep context under about 100k it's genuinely on par with Opus for me, and in some ways it's arguably better.

100k tokens it's basically nothing these days. Claude Opus 4.6M with 1M context windows is just a different ball game

Personal opinions follow:

Claude Opus at 150K context starts getting dumber and dumber.

Claude Opus at 200K+ is mentally retarded. Abandon hope and start wrapping up the session.

Re: GLM-5.1: Towards Long-Horizon Tasks

#70
post #58

Earlier quoted context omitted.

100k tokens it's basically nothing these days. Claude Opus 4.6M with 1M context windows is just a different ball game

Don’t want to disappoint you, but above 200k opus memory is like a gold fish. You need to be below 150k to get good research and implementation.

Oh nice, I just wrote pretty much the same comment above yours.
Post reply on HN