Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.3: Frontier coding with emergent cyber capabilities

z.ai

Post reply on HN
Print view View original

21–30 of 626 posts

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#21

Post by SwellJoe »

newyankee wrote: post #2

A flood of releases today, really difficult to make out for someone who does not use or test all these models on complex real world use cases as to how people decide which ones to use (besides price)

Count yourself lucky that you don't feel compelled to try them all yourself immediately. I'm just trying to decide whether to get a Z.ai coding plan or wait until it appears on OpenRouter. 5.2 was quite solid, but it was just shy of Opus 4.8 in my benchmarks of security auditing capabilities. I've mostly been using Kimi K3, because American vendors won't let the peasantry use their best models for security work.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#22

Post by bpodgursky »

kouteiheika wrote: post #14
aliljet wrote: post #5

This is absolutely still shy of Sol and Fable, but only just by a hair. Ridiculous results. There's still not a compelling economic reason to drop OpenAI courtesy of the ludicrous reset addiction that's taken place, but it feels like we're on the precipice. How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with p…

> This is absolutely still shy of Sol and Fable Not sure about Sol as I haven't used it, but, at least for security work -- does it matter? It's not like you will be allowed to use Fable (or access Mythos) for anything cybersecurity-related unless your name is "Dario Amodei" or you are one of his rich friends. So regardless of how good Fable/Mythos is here it's a completely moot point for normal people, because they…

I don't understand all this spite about "rich friends" when it was the US government that shut Fable down for not adequately blocking cyber capabilities.

I mean what honestly are you thinking Anthropic can do to give you better cyber tools? Their frontier model was literally nuked by the feds for a month for doing it.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#23

Post by teravor »

aliljet wrote: post #5

This is absolutely still shy of Sol and Fable, but only just by a hair. Ridiculous results. There's still not a compelling economic reason to drop OpenAI courtesy of the ludicrous reset addiction that's taken place, but it feels like we're on the precipice. How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with p…

the difference is that with open models jailbreaking is trivial if you know what you are doing so this makes a frontier open model infinitely more useful for certain tasks seeing as closed frontier models will just refuse (and jailbreaking them is a waste of time when you have good open models).

in some cases (mainly reverse engineering) I have observed GLM 5.2 jailbreaking itself with no effort on my part, the thinking trace revealed that it did some mental gymnastics to pretend it was a crackme or capture the flag competition.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#25

Post by peddling-brink »

mostlyk wrote: post #3

Incredible numbers, will have to wait and see how it actually performs. The timing of GLM updates are always suprising

Yeah, but it hasn't even broken containment and cheated its way to victory.. Might as well use haiku.

/s

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#26

Post by SwellJoe »

LeonidBugaev wrote: post #16
virgildotcodes wrote: post #4

OpenAI and Anthropic need to just go ahead and give people access to the cyber models. Otherwise we have a world of attackers using open and closed source models against a much smaller group of maintainers that are likely heavily dependent on Anthropic and OpenAI and for whom it may not be a simple matter to just get approval to start using the open model flavor of the month.

Not only attackers. I have to switch to Kimi or GLM even in cases of basic issue triage on my own projects! Current guardrails are ridiculous.

I've been building a harness for security work, and had to switch to GPT 5.5 when even Opus started refusing security work. Then 5.6 Sol arrived, and it refuses security work, too. So, I switched to Kimi K3 and DeepSeek for API testing just because it's so much cheaper. But, if GLM is better, I'm here for it, as I think GLM is also cheaper than K3.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#27

Post by SwellJoe »

quantumwoke wrote: post #12

Feels like Fable's edge ended up just being long horizon task scaling, which post-training seems to achieve as seen here. Wonder what the next frontier is? Improvement in specialised tasks or computer use?

Anthropic needs to teach Opus how to speak English again, because Opus 5 seems to have forgotten. Utterly incoherent a lot of the time. They seem to be so busy scare-mongering and cooking up guardrails and watermarks that they haven't noticed that their models are getting weird.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#28

Post by bossyTeacher »

aliljet wrote: post #5

This is absolutely still shy of Sol and Fable, but only just by a hair. Ridiculous results. There's still not a compelling economic reason to drop OpenAI courtesy of the ludicrous reset addiction that's taken place, but it feels like we're on the precipice. How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with p…

> This is absolutely still shy of Sol and Fable, but only just by a hair.

Even if there was a small/medium gap, the fact that this is a free model beats both of the above on pure economics.

Post reply on HN