Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM 5.2 Is Out

twitter.com

Post reply on HN
Print view View original

271–280 of 544 posts

Re: GLM 5.2 Is Out

#271

Post by IgorPartola »

thewebguyd wrote: post #87
khalic wrote: post #61

Given the US government’s latest stunt with Fable, this is looking more and more like the future. Can’t rely on strategic products if they’re gated by capricious actors. Open weight models are basically immune to that

> Open weight models are basically immune to that Somewhat. The US Gov can make it illegal to transact with, download, use, etc. foreign open weight models. Of course, enforcement will be difficult for individuals (businesses will comply by default, and they would all be pulled off Github and other US based hosting locations if they went the sanctions route). But, we are also quickly going down the road of frightenin…

Since I am not familiar with the law, can you expand on the mechanism by which the US government could making downloading openly licensed files illegal? How would the government avoid denying people their first amendment rights by doing this?

Re: GLM 5.2 Is Out

#272

Post by SwellJoe »

sgc wrote: post #172
wgd wrote: post #118

Earlier quoted context omitted.

The GLM-5 series is 744B-A40B. This is not a local model for any reasonable definition of local, but it's an open model which means (once they upload the weights in a week or so) there will be a dozen third-party inference providers competing on price per token.

As far as I can tell this type of model requires 640GB+ of memory using FP8. So likely can be run using 320GB+ memory if using FP4 or similar. So that would be 3 Nvidia DGX Sparks, or 12k of hardware. Is that correct? If so, it could make perfect sense for a small business.

The performance would be abysmal spread across four Sparks, I'd think, though I guess MoE mitigates that somewhat. Still better to just pay for it in the cloud. (Though I've spent about $4k on local compute for AI experimentation, I don't think it pays for itself, I just like tinkering.)

Re: GLM 5.2 Is Out

#273

Post by matheusmoreira »

nozzlegear wrote: post #248
matheusmoreira wrote: post #232

Earlier quoted context omitted.

Backing any large US company effectively means backing the US government and its worldwide oppression as well. I still can't get over the fact it was the land of the free who was the first to ban strong LLM models. If backing China helps undermine that nonsense then I'm afraid I'll take them up on their offer.

AI services are regulated by default in China, operators have to be pre-license their models to release them to the public. The Anthropic case wouldn't happen in China because China regulates the model and requires the company to register users with their phone number/national id number.

And yet they're the ones releasing weights for all to use.

Re: GLM 5.2 Is Out

#274

Post by no-name-here »

ryandrake wrote: post #206
no-name-here wrote: post #169

Earlier quoted context omitted.

Is it? Would bioweapon instruction restrictions be equivalent to disallowing reporting on whether the government is massacring large numbers of citizens in your city? Both are ‘censorship’ but don’t seem remotely equivalent to me.

That’s the thing about principled positions. If you believe censorship is wrong, then it is equally wrong no matter what the topic is.

Do you believe it’s only censorship where context shouldn’t be applied? Like if someone had a principled view "violence is wrong", would non-lethal violence in a clear case of self-defense be “equally wrong” as the guy who personally killed tens of thousands of captured POWs (Blokhin)? As “violence is violence”?

Re: GLM 5.2 Is Out

#275

Post by californical »

IgorPartola wrote: post #271
thewebguyd wrote: post #87

Earlier quoted context omitted.

> Open weight models are basically immune to that Somewhat. The US Gov can make it illegal to transact with, download, use, etc. foreign open weight models. Of course, enforcement will be difficult for individuals (businesses will comply by default, and they would all be pulled off Github and other US based hosting locations if they went the sanctions route). But, we are also quickly going down the road of frightenin…

Since I am not familiar with the law, can you expand on the mechanism by which the US government could making downloading openly licensed files illegal? How would the government avoid denying people their first amendment rights by doing this?

I mean my state has been making it illegal to download 3d models of pieces that could be used to make guns in a 3d printer

It’s a very broad law and likely not legal, but it’s going to take a long time to be fought through the courts, and in the meanwhile people will probably be arrested for creating or sharing a file for something that may be able to become a gun part.

You’re correct that it shouldn’t be a thing but unfortunately American society is not in a good place right now

Re: GLM 5.2 Is Out

#276

Post by [deleted] »

Reubend wrote: post #38

Seems like there's no official blog post with benchmark results yet. But I'm once again thankful for the Chinese AI labs for being open with their work and contributing it to the world under permissive licenses like this. The Fable 5 fiasco is just another reminder of how valuable these things are to have.

[deleted]

Re: GLM 5.2 Is Out

#279

Post by 20after4 »

tshaddox wrote: post #265
anon373839 wrote: post #125

Earlier quoted context omitted.

> This is not a local model for any reasonable definition of local That's true for now. I am hopeful that once the hardware markets have recovered from OpenAI's sabotage, we will see more hardware dedicated to local inference that can handle these big models. Also, I'm thinking about the unique MoE routing that Apple is using with their new Apple Foundation Model. The model is trained and architected so that experts…

Is there reason to expect the consumer hardware markets to recover any time soon? Is there reason to expect they’ll ever recover without an AI bust that takes down the U.S. economy?

I don't think it'll ever recover. Partially perhaps. But we have bigger problems to worry about really.

Re: GLM 5.2 Is Out

#280

Post by Mashimo »

easygenes wrote: post #49

This release was rushed to hang on the coattails of the Mythos drama (“hey, sorry you can’t use Fable, but try us while you wait this weekend!”) I think they planned to release next week, hence benchmarks not all being ready yet.

Could be, but AFAIK it was similar with other glm releases. Just a Twitter post with blog post coming later.
Post reply on HN