Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.3: Frontier coding with emergent cyber capabilities

z.ai

Post reply on HN
Print view View original

31–40 of 626 posts

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#31

Post by deepllm »

bpodgursky wrote: post #22
kouteiheika wrote: post #14

Earlier quoted context omitted.

> This is absolutely still shy of Sol and Fable Not sure about Sol as I haven't used it, but, at least for security work -- does it matter? It's not like you will be allowed to use Fable (or access Mythos) for anything cybersecurity-related unless your name is "Dario Amodei" or you are one of his rich friends. So regardless of how good Fable/Mythos is here it's a completely moot point for normal people, because they…

I don't understand all this spite about "rich friends" when it was the US government that shut Fable down for not adequately blocking cyber capabilities. I mean what honestly are you thinking Anthropic can do to give you better cyber tools? Their frontier model was literally nuked by the feds for a month for doing it.

"Mythos" is the cyber-security equivalent of Fable (without guardrails), and only a very select few corporations have access to it.

Fable is their version with guardrails on everything except "Make me a pelican svg" or "create a to-do" app, that is the version that the government banned

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#33

Post by simonjgreen »

kouteiheika wrote: post #14
aliljet wrote: post #5

This is absolutely still shy of Sol and Fable, but only just by a hair. Ridiculous results. There's still not a compelling economic reason to drop OpenAI courtesy of the ludicrous reset addiction that's taken place, but it feels like we're on the precipice. How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with p…

> This is absolutely still shy of Sol and Fable Not sure about Sol as I haven't used it, but, at least for security work -- does it matter? It's not like you will be allowed to use Fable (or access Mythos) for anything cybersecurity-related unless your name is "Dario Amodei" or you are one of his rich friends. So regardless of how good Fable/Mythos is here it's a completely moot point for normal people, because they…

We applied for the cybersecurity approval via the form and got approval back in less than an hour. Have you… tried?

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#34

Post by npn »

Gecko4072 wrote: post #15

People familiar with the topic, how will models continue to get better? Post training it seems? Labs have already used up internet-scale data, so are there any limits to architecture improvements and post training or can we expect this trend to continue? ByteDance is training a 10T-parameter model. Here, GLM 5.3 outperforms models 3-4x its size of roughly 700B, so parameter count doesn’t seem to be a direct correlati…

> used up internet-scale data

yet but it is still contain a lot of trash. you need better models to process those trash and create a curate dataset. this will happen again and again until there is no more juice to squeeze. and I'm sure we are still not done with it.

> post training

yeah this will be crucial. the big models are already too capable, they are just not that aligned with current agent tasks.

> parameter count doesn’t seem to be a direct correlation anymore

I don't think so, remember that chinese labs do not have as much compute power compare to US frontier labs. that's why deepseek v4 flash had that huge jump and deepseek v4 pro is kinda a disappointment, they just do not have the compute power to proper posttrain the pro model like they wanted. glm is also a relative small model so you also can see the huge jump with just post training. so it does not mean the size does not matter, it is just mean that the chinese labs currently only capable of training smaller models effectively.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#37

Post by aand16 »

> Mythos 5 remains well ahead at 181 and 247 tasks. The pattern across the three is consistent: the further up the exploitation chain a benchmark sits, the wider the remaining gap to the closed frontier. Capability is growing fastest exactly where we are furthest behind.

I appreciate they don't just take the opportunity to self-glaze.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#38

Post by deepllm »

aliljet wrote: post #5

This is absolutely still shy of Sol and Fable, but only just by a hair. Ridiculous results. There's still not a compelling economic reason to drop OpenAI courtesy of the ludicrous reset addiction that's taken place, but it feels like we're on the precipice. How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with p…

Realistically, you're looking at least 2x DGX sparks to run this at a 2 bit quant, but quantization really lobotomizes models so it's just better to run DSv4 flash at full precision.

4x DGX sparks should let you run this at 4 bit at least and there are some folks who ran GLM 5.2 on this configuration in r/LocalLlama

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#39

Post by kouteiheika »

bpodgursky wrote: post #22
kouteiheika wrote: post #14

Earlier quoted context omitted.

> This is absolutely still shy of Sol and Fable Not sure about Sol as I haven't used it, but, at least for security work -- does it matter? It's not like you will be allowed to use Fable (or access Mythos) for anything cybersecurity-related unless your name is "Dario Amodei" or you are one of his rich friends. So regardless of how good Fable/Mythos is here it's a completely moot point for normal people, because they…

I don't understand all this spite about "rich friends" when it was the US government that shut Fable down for not adequately blocking cyber capabilities. I mean what honestly are you thinking Anthropic can do to give you better cyber tools? Their frontier model was literally nuked by the feds for a month for doing it.

> I don't understand all this spite about "rich friends"

Okay, here's a challenge: I assume you're not a rich and powerful entity, so try to gain access to Mythos. I'll wait.

> I mean what honestly are you thinking Anthropic can do to give you better cyber tools? Their frontier model was literally nuked by the feds for a month for doing it.

Well, first I'd suggest they stop with the constant fear mongering.

Here's my prediction for what will happen: the Chinese models will catch up to Fable/Mythos. They will be fully unrestricted and everyone will have access. The world will not end. Good guys will use them to harden their systems, in equilibrium to what bad guys have access to, so effectively status quo will not change.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#40

Post by tjwebbnorfolk »

wxw wrote: post #7

> Scaling post-training is all we did for GLM-5.3. Love this opening line. And wow, great results. > As agent capability improves, much of the difficulty in scaling post-training moves from the model to the environment.

does this suggest 5.3 is the same # of parameters as 5.2?
Post reply on HN