Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.3: Frontier coding with emergent cyber capabilities

z.ai

Post reply on HN
Print view View original

41–50 of 626 posts

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#41

Post by bpodgursky »

deepllm wrote: post #31
bpodgursky wrote: post #22

Earlier quoted context omitted.

I don't understand all this spite about "rich friends" when it was the US government that shut Fable down for not adequately blocking cyber capabilities. I mean what honestly are you thinking Anthropic can do to give you better cyber tools? Their frontier model was literally nuked by the feds for a month for doing it.

"Mythos" is the cyber-security equivalent of Fable (without guardrails), and only a very select few corporations have access to it. Fable is their version with guardrails on everything except "Make me a pelican svg" or "create a to-do" app, that is the version that the government banned

I know all this?

Only a few corporations have Mythos because the US government is whitelisting them one at a time. Anthropic releasing Mythos to the public was never on the table, they would have been shut down in milliseconds by the feds if they tried.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#42

Post by teruakohatu »

deepllm wrote: post #38
aliljet wrote: post #5

This is absolutely still shy of Sol and Fable, but only just by a hair. Ridiculous results. There's still not a compelling economic reason to drop OpenAI courtesy of the ludicrous reset addiction that's taken place, but it feels like we're on the precipice. How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with p…

Realistically, you're looking at least 2x DGX sparks to run this at a 2 bit quant, but quantization really lobotomizes models so it's just better to run DSv4 flash at full precision. 4x DGX sparks should let you run this at 4 bit at least and there are some folks who ran GLM 5.2 on this configuration in r/LocalLlama

How fast are 2x or 4x DGX?

I only have one and am wondering what the benefits are of getting another. I feel I will be disappointed…

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#43

Post by bpodgursky »

kouteiheika wrote: post #39
bpodgursky wrote: post #22

Earlier quoted context omitted.

I don't understand all this spite about "rich friends" when it was the US government that shut Fable down for not adequately blocking cyber capabilities. I mean what honestly are you thinking Anthropic can do to give you better cyber tools? Their frontier model was literally nuked by the feds for a month for doing it.

> I don't understand all this spite about "rich friends" Okay, here's a challenge: I assume you're not a rich and powerful entity, so try to gain access to Mythos. I'll wait. > I mean what honestly are you thinking Anthropic can do to give you better cyber tools? Their frontier model was literally nuked by the feds for a month for doing it. Well, first I'd suggest they stop with the constant fear mongering. Here's my…

This is a lot of words to say "you're right, Anthropic does not have any legal way to release frontier cyber capabilities to the public"

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#44

Post by kouteiheika »

simonjgreen wrote: post #33
kouteiheika wrote: post #14

Earlier quoted context omitted.

> This is absolutely still shy of Sol and Fable Not sure about Sol as I haven't used it, but, at least for security work -- does it matter? It's not like you will be allowed to use Fable (or access Mythos) for anything cybersecurity-related unless your name is "Dario Amodei" or you are one of his rich friends. So regardless of how good Fable/Mythos is here it's a completely moot point for normal people, because they…

We applied for the cybersecurity approval via the form and got approval back in less than an hour. Have you… tried?

Have you tried to use Fable for anything even remotely security related, when the refusals kick in as soon as you even fart in the vague direction of anything security or biology-adjacent?

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#45

Post by fahrradflucht »

tjwebbnorfolk wrote: post #40
wxw wrote: post #7

> Scaling post-training is all we did for GLM-5.3. Love this opening line. And wow, great results. > As agent capability improves, much of the difficulty in scaling post-training moves from the model to the environment.

does this suggest 5.3 is the same # of parameters as 5.2?

“Today we are releasing GLM-5.3. It uses the same base model as GLM-5.2 — every gain comes from post-training.“

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#46

Post by aabhay »

aand16 wrote: post #37

> Mythos 5 remains well ahead at 181 and 247 tasks. The pattern across the three is consistent: the further up the exploitation chain a benchmark sits, the wider the remaining gap to the closed frontier. Capability is growing fastest exactly where we are furthest behind. I appreciate they don't just take the opportunity to self-glaze.

[flagged]

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#47

Post by hypfer »

SwellJoe wrote: post #27
quantumwoke wrote: post #12

Feels like Fable's edge ended up just being long horizon task scaling, which post-training seems to achieve as seen here. Wonder what the next frontier is? Improvement in specialised tasks or computer use?

Anthropic needs to teach Opus how to speak English again, because Opus 5 seems to have forgotten. Utterly incoherent a lot of the time. They seem to be so busy scare-mongering and cooking up guardrails and watermarks that they haven't noticed that their models are getting weird.

Are those watermarks why claude suddenly started being even more unbearable to work with lately?

Man. That would make a lot of sense indeed.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#48

Post by disiplus »

deepllm wrote: post #38
aliljet wrote: post #5

This is absolutely still shy of Sol and Fable, but only just by a hair. Ridiculous results. There's still not a compelling economic reason to drop OpenAI courtesy of the ludicrous reset addiction that's taken place, but it feels like we're on the precipice. How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with p…

Realistically, you're looking at least 2x DGX sparks to run this at a 2 bit quant, but quantization really lobotomizes models so it's just better to run DSv4 flash at full precision. 4x DGX sparks should let you run this at 4 bit at least and there are some folks who ran GLM 5.2 on this configuration in r/LocalLlama

i run flash v4 at 2bit, its pretty great and on my tests against full model It didn't lose any capabilities. It just was thinking more. So you don't have the same efficiency.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#49

Post by deepllm »

bpodgursky wrote: post #41
deepllm wrote: post #31

Earlier quoted context omitted.

"Mythos" is the cyber-security equivalent of Fable (without guardrails), and only a very select few corporations have access to it. Fable is their version with guardrails on everything except "Make me a pelican svg" or "create a to-do" app, that is the version that the government banned

I know all this? Only a few corporations have Mythos because the US government is whitelisting them one at a time . Anthropic releasing Mythos to the public was never on the table, they would have been shut down in milliseconds by the feds if they tried.

Before the US government had anything to do with this, Anthropic were fear mongering Mythos (BTW, Amodei also fear-mongered GPT-2, so this is a normal pattern in their operation) calling it "too dangerous to release", and back then only Anthropic was in charge of the whitelist.

Then the government believed Amodei's bullshit and this is a result of that, this was all self-inflicted.

Post reply on HN