Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.3: Frontier coding with emergent cyber capabilities

z.ai

Post reply on HN
Print view View original

551–560 of 626 posts

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#551

Post by RussianCow »

Garpagan wrote: post #521
weego wrote: post #489

Earlier quoted context omitted.

what is a harness? The comments below are mixing IDE/ADE but other suggestions are purely terminal things and I don't get what their value is over just a terminal. Is a harness like a loop where it's just a vague thing that everyone nods about but everyone is nodding at something different?

Harness is a set of artisanal prompts.

You might be joking, but a harness provides much more than just the prompts: at a minimum, it provides the system prompt and the built-in tools that the LLM can use, but it can also provide things like subagent management, custom compaction logic, session forking, etc.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#552

Post by SwellJoe »

BeanAndCookies wrote: post #416
gdhkgdhkvff wrote: post #343

Earlier quoted context omitted.

Isn’t this essentially what anthropic is doing, albeit in a manual fashion? They work with code owners to run mythos and find issues.

OpenAI now makes it easy to join their verified security program. Took me 5 minutes, and I was able to get GPT to do a full end-to-end pen test

Doesn't that require a business account (so, actually, two business accounts since that's the minimum)?

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#553

Post by [deleted] »

cyanydeez wrote: post #543
andxor wrote: post #522

Earlier quoted context omitted.

Are you assuming it won't?

I mean, I stil think we live in a rational world of fixed resources even if those resources are billionaire's market cap that's indistinguishable from NFTs. Just watched a youtube where sethgreen crashes the entire NFT market because his got stolen for some TV show that was supposse to showcase the value of "owning" and NFT. So like, in theory, sure, they can keep burning their NFTs. In practice though, it just takes…

[deleted]

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#554

Post by johnnyApplePRNG »

aliljet wrote: post #5

This is absolutely still shy of Sol and Fable, but only just by a hair. Ridiculous results. There's still not a compelling economic reason to drop OpenAI courtesy of the ludicrous reset addiction that's taken place, but it feels like we're on the precipice. How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with p…

These resets are not nearly enough.

I am in the process of creating my own Pi Coding Agent harness to leverage the power of Deepseek V4 Flash 0731 and other models (you can do that when you build your own harness! easily route opinions from other models whenever you're stuck, etc) and cancelling my Codex account next week.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#556

Post by clbrmbr »

leobuskin wrote: post #305

I bought $18 GLM official subscription yesterday (5.2, but new model version was already leaking on some docs), set it up with Claude Code harness... and I’ve bumped to $80 plan almost immediately. It’s the first model that agreed on a proper security research (red team scenario), executed it seamlessly, including 0-days in WP plugins, RCE, 6.8 kernel exploit adaptation, etc - while playing against another GLM agent…

How are you using it in Claude Code? What is the native harness that GLM was post-trained in?

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#557

Post by vinhnx »

rattlesnakedave wrote: post #324
leobuskin wrote: post #305

I bought $18 GLM official subscription yesterday (5.2, but new model version was already leaking on some docs), set it up with Claude Code harness... and I’ve bumped to $80 plan almost immediately. It’s the first model that agreed on a proper security research (red team scenario), executed it seamlessly, including 0-days in WP plugins, RCE, 6.8 kernel exploit adaptation, etc - while playing against another GLM agent…

You should try a better harness. Try pi, or ohmypi if you want a good OOB experience

I have been building and maintaining a coding harness, with help from the community https://github.com/vinhnx/VTCode. Hope you'll check it out.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#558

Post by dannyw »

cmrdporcupine wrote: post #290
bertili wrote: post #243

This will be roughly on pair with Kimi K3, but using a third of its parameters. Just 4 weeks ago the "Kimi K3 moment" was seen as a threat to Closed AI and in less than a month Z.ai have cut the parameter/RAM barrier to a third. Congratulation to Z.ai and all the hard working Chinese researchers who are quitely boiling the frog.

Congrats def in order but as usual the proof will be in the pudding of actually running the thing. GLM 5.2 has token efficiency problems. It's not a stupid model, but it takes a lot of "thinking" to produce not-stupid results. ("But wait..."). Which makes its pricing deceptive. I tried to get by through the month of June on just GLM 5.2 and it was ... fine-ish for about two weeks. But the provider situation wasn't id…

Have you counted your thinking tokens for say Opus or Fable? It wouldn’t surprise me if frontier closed models “over-reason” just as much, but you don’t see it thanks to the summariser.

(We do know GPT5.6 have adopted the caveman shorthand, which explains its token efficiency).

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#559

Post by dannyw »

andai wrote: post #432
kevincox wrote: post #309

Earlier quoted context omitted.

This isn't latency bound, it is trivially parallelize. So you want to run it on the most efficient compute you have, not the fastest.

OpenAI was bragging the other day about how HLE on Cerebras only took 11 hours. But you're saying if they just spun up a separate cheapo VM for each task, it would have finished faster and cheaper?

Models are trained in highly distributed and parallel ways these days.

It is entirely possible to run multiple concurrent post-training runs. When a frontier lap deploys a 1M RL gym rollout, these 1M environments are absolutely not talking to each other or interconnected. They individually generate traces and movements that can be then combined for post training.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#560

Post by dannyw »

Gecko4072 wrote: post #110
vmware508 wrote: post #106

Apple will release M7 MacBook Pros / Mac Minis next year, and they will be able to run free LLMs locally at native speed. All software developer notebooks will be replaced to run local models, saving a lot by cancelling Claude Code subscriptions. Developers win. Apple stocks will be rocketing. Everything else will go down. You're welcome.

They will cost an insane amount as well. Maybe less than subscriptions or tokens. But running massive models on laptops with batteries and poor cooling doesn’t make much sense.

If you're a company with a considerable API bill, buying a few Blackwells and a rack could make a lot of economic sense, while still giving your security team full control of the infrastructure
Post reply on HN