Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.3: Frontier coding with emergent cyber capabilities

z.ai

Post reply on HN
Print view View original

211–220 of 626 posts

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#211

Post by jcfrei »

Gigachad wrote: post #124
MangoCoffee wrote: post #53

Earlier quoted context omitted.

OpenAI and Anthropic are both seeking trillion IPOs, while Chinese labs are pumping out open-weight models that are free for US providers to host and monetize. These Chinese models cost less of US SOTA models to run, even if they are less capable. Providers can just run them, offer cheap tokens, and pocket the margin. I just don't see how you justify a trillion valuation for US AI labs when the underlying models are…

This is going to be catastrophic. Whether AI works or is useful or not isn’t even the question anymore. It can fulfil every promise Sam Altman has been making and will still make no financial sense to justify these valuations.

A lot of the performance of these open source models might come from distilling the closed frontier models. If those can't raise the funds anymore to train newer and better models then the whole improvement cycle might slow down.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#212

Post by KeplerBoy »

andsoitis wrote: post #204
KeplerBoy wrote: post #82

Earlier quoted context omitted.

Which is not unreasonable. Just hosting it in the EU and promising not to retain / sell the data let's you charge a healthy extra and compete in many areas other players can't.

> Just hosting it in the EU and promising not to retain / sell the data let's you charge a healthy extra and compete in many areas other players can't. It's been a few years. Has anyone done this successfully yet?

melious.ai comes to mind.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#214

Post by cromka »

Gigachad wrote: post #124
MangoCoffee wrote: post #53

Earlier quoted context omitted.

OpenAI and Anthropic are both seeking trillion IPOs, while Chinese labs are pumping out open-weight models that are free for US providers to host and monetize. These Chinese models cost less of US SOTA models to run, even if they are less capable. Providers can just run them, offer cheap tokens, and pocket the margin. I just don't see how you justify a trillion valuation for US AI labs when the underlying models are…

This is going to be catastrophic. Whether AI works or is useful or not isn’t even the question anymore. It can fulfil every promise Sam Altman has been making and will still make no financial sense to justify these valuations.

I seriously need to start considering the scenario in which this leads to next global financial crisis.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#215

Post by andsoitis »

toasty228 wrote: post #156
kyxsc wrote: post #134

Earlier quoted context omitted.

for example, models running at like 100-150 tokens/second (or faster!) vs 15 t/s (fable/sol are ~60 t/s, and OpenAI just announced their Cerebras partnership(?) for "ultrafast" mode of 750 t/s) models aren't able to run that fast right now on our consumer/prosumer hardware. M5 Max for example has a memory bandwidth of 600 GB/s. a 5090 has 3x that, so running the same model on a 5090 is that much faster (provided the…

Meanwhile the GB300 used by hosted llms: GPU Memory Bandwidth: 7.1 TB/s Interconnect Bandwidth: 900 GB/s bidirectional https://pi3g.com/nvidia-gb300-specifications-including-memor... If you think M7 will hit even 15% of these speeds you're very optimistic.

A hosted instance serves multiple customers at a time. A local model only one.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#216

Post by virgildotcodes »

surgical_fire wrote: post #171
virgildotcodes wrote: post #4

OpenAI and Anthropic need to just go ahead and give people access to the cyber models. Otherwise we have a world of attackers using open and closed source models against a much smaller group of maintainers that are likely heavily dependent on Anthropic and OpenAI and for whom it may not be a simple matter to just get approval to start using the open model flavor of the month.

Can't the maintainers use the same models as the attackers? The maintainers don't need approval to use GLM.

They may need approval from their employers.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#217

Post by csomar »

Flavius wrote: post #126
vmware508 wrote: post #106

Apple will release M7 MacBook Pros / Mac Minis next year, and they will be able to run free LLMs locally at native speed. All software developer notebooks will be replaced to run local models, saving a lot by cancelling Claude Code subscriptions. Developers win. Apple stocks will be rocketing. Everything else will go down. You're welcome.

> run free LLMs locally at native speed This reads like a hallucination. What does native speed even mean?

There should be some kind of moratorium on new accounts. HN's always had waves of newcomers, but their impact was always limited. The wave passes and people either get filtered out or adapt. That doesn't seem to be happening anymore, since bots can churn out endless gibberish.

He did answer you though. Native is x10 the non-native speed. 50/50 that's not a bot; though it could be a meat-proxy

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#218

Post by vjvjvjvjghv »

croon wrote: post #183
cromka wrote: post #175

Earlier quoted context omitted.

Looks like they're going for good PR now, to avoid smearing by the "Western" models. Smart!

I'd love to live in a society where people and corporations do good things for PR.

PR for good things doesn’t make money.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#219

Post by nozzlegear »

charcircuit wrote: post #83
MangoCoffee wrote: post #53

Earlier quoted context omitted.

OpenAI and Anthropic are both seeking trillion IPOs, while Chinese labs are pumping out open-weight models that are free for US providers to host and monetize. These Chinese models cost less of US SOTA models to run, even if they are less capable. Providers can just run them, offer cheap tokens, and pocket the margin. I just don't see how you justify a trillion valuation for US AI labs when the underlying models are…

I suggest you think why OpenAI was worth billions before ChatGPT. The valuation is not about how the current set of models can be monetized.

Could you just tell us why you think they were worth billions before ChatGPT, instead of suggesting that we think on it? You seem to know the answer already, so please share it with the class.

Re: GLM-5.3: Frontier coding with emergent cyber capabilities

#220

Post by tjpnz »

jcfrei wrote: post #211
Gigachad wrote: post #124

Earlier quoted context omitted.

This is going to be catastrophic. Whether AI works or is useful or not isn’t even the question anymore. It can fulfil every promise Sam Altman has been making and will still make no financial sense to justify these valuations.

A lot of the performance of these open source models might come from distilling the closed frontier models. If those can't raise the funds anymore to train newer and better models then the whole improvement cycle might slow down.

Does stealing from a thief still amount to theft?
Post reply on HN