Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GLM-5.3-Flash

z.ai

Post reply on HN
Print view View original

51–60 of 605 posts

Re: GLM-5.3-Flash

#51

Post by cootsnuck »

If we fast forward say 5 years, I don't see how we don't end up in world where people (and enterprises) are more savvy with how they use LLMs. Meaning, more models, smaller models, weirder models, more specialized models, etc. And all of it running on a variety of hardware (edge devices, personal computers, on-demand cloud compute).

I don't see how NVIDIA can keep their spot as belle of the ball. If LLMs and friends are truly to become as useful and ubiquitous as everyone thinks they will, then commoditization is the only option.

Re: GLM-5.3-Flash

#52

Post by swiftcoder »

a3w wrote: post #46
swiftcoder wrote: post #43

Earlier quoted context omitted.

> it's the only model in the whole lineup that isn't priced insanely $4,000 isn't priced insanely? ye gads

I thought 4000 in sum. No wait, 4000 per , plus tax. Or EUR pricing to similar accord. Ouch.

Yeah, that little cluster costs about the same as a brand-new Dacia Sandero.

Re: GLM-5.3-Flash

#53

Post by nchmy »

yipinwong wrote: post #47

When reading this type of announcements, always have keen eyes on graphs. e.g. "Agent Coding Performance by Effort Level" cuts Y-axis from 0~20. - This makes it as if GLM-5.3-Flash made a bigger jump than it claimed as the Y-axis does not increase much (stupid trick used in biz reports) I did mention that ox was working ok for me, and having an open-weight comparable to close to SOTA makes it very compelling for me t…

they also conspicuously omitted GPT 5.6 Luna from comparison. It scores lower, but is also cheaper. MiMo 2.5 is not a valid comp at this point

edit: nevermind. it is there in the artifical analysis scatter plot, but is greyed-out.

MUCH more interesting is that in that chart, their cost is WAY off. The actual chart shows GLM 5.3 Flash at $0.09, but their chart shows $0.045...

Re: GLM-5.3-Flash

#54

Post by cmrdporcupine »

mmastrac wrote: post #17
kilroy123 wrote: post #13

Earlier quoted context omitted.

> get myself four sparks at a decent price Wow, if you don't mind me asking. How and where?

I bought 4x Asus GX10 with the 1TB option. I don't understand why, but it's the only model in the whole lineup that isn't priced insanely. They were briefly on sale with a $200-off coupon, but they show up on warehouse deals from time-to-time as well.

I mean, I have the same machine and the pricing is only what it is because it has that 1TB nVME in it instead of larger. nVME prices are insane and have been for months.

Reality is on a single spark I'm constantly running out of room and it being an odd size M.2 slot it's a pain to upgrade. I'm setting up a NAS over RDMA via ConnectX though, that's fun.

Re: GLM-5.3-Flash

#55

Post by 0xbadcafebee »

mmastrac wrote: post #7

Weights on HF here: https://huggingface.co/zai-org/GLM-5.3-Flash I decided to take the plunge and get myself four sparks at a decent price (and bought the QSFP cables from AliExpress because they are literally 1/2 the price of Amazon), even knowing Apple was going to release new hardware and there's probably a spark 2 on the horizon. It looks like this is going to be a decent fit for what I need. I've been experiment…

If you used the bare API pricing, 1M tokens @ 30% input/70% output/50% cached, you'd pay $0.05805. Even with four discounted sparks, how much are you paying for the same tokens/distribution?

Re: GLM-5.3-Flash

#56

Post by nananana9 »

himata4113 wrote: post #39
epolanski wrote: post #4

I'm starting to think that this whole sanctioning China may motivate and prompt them to do more and better in every field. It's too big, bright and resourceful of a country to choose confrontation instead of collaboration.

Well the big problem with china is that they do not respect international law when it comes to technology theft. But that argument is very weak when it appears that a lot of what they do is out in the open for anyone to replicate.

That's how you catch up when you're behind.

Now the US is behind in EVs can you guess what they're doing? [1]

[1] https://evwire.com/p/video-ford-ceo-jim-farley-says-they-fly...

Re: GLM-5.3-Flash

#57

Post by esafak »

swiftcoder wrote: post #43
mmastrac wrote: post #17

Earlier quoted context omitted.

I bought 4x Asus GX10 with the 1TB option. I don't understand why, but it's the only model in the whole lineup that isn't priced insanely. They were briefly on sale with a $200-off coupon, but they show up on warehouse deals from time-to-time as well.

> it's the only model in the whole lineup that isn't priced insanely $4,000 isn't priced insanely? ye gads

Yes, but it was $200 off!

Re: GLM-5.3-Flash

#58

Post by redox99 »

sunbum wrote: post #5

> with all of this traffic served on Chinese AI chips RIP Nivida shareholders

Not really a brag: it ran like shit. Very slow (~20tps, VERY high latency) and it would timeout all the time.

I'm sure the chips are fine, but they clearly didn't have enough capacity for the demand they had (that 100T/day claim was asbolute bs)

Re: GLM-5.3-Flash

#59

Post by mlinsey »

ignoramous wrote: post #50
dannyw wrote: post #38

Earlier quoted context omitted.

Another self-inflicted own courtesy of US government policy. While I think China would always get to hardware self-sufficiency eventually, all export controls have done is (1) accelerate China's development, and (2) divert revenue that would've otherwise gone to NVIDIA/AMD/etc instead.

The export controls were revoked before it triggered Chinese protectionism: https://www.silicon.co.uk/e-innovation/artificial-intelligen... / https://archive.vn/B2pah

Revoked or not, just ever having those controls signals to the Chinese ecosystem that you're not necessarily a reliable supplier (Would you trust US export policy to remain stable for the next ~decade given the state of US politic?) and to the Chinese government just how strategically important you see these components.

This isn't the kind of thing you can hash out in public and go back and forth on. Once you put it out there, the other party will take steps to make sure they don't have to rely on us in the long run.

Re: GLM-5.3-Flash

#60

Post by Aurornis »

mmastrac wrote: post #7

Weights on HF here: https://huggingface.co/zai-org/GLM-5.3-Flash I decided to take the plunge and get myself four sparks at a decent price (and bought the QSFP cables from AliExpress because they are literally 1/2 the price of Amazon), even knowing Apple was going to release new hardware and there's probably a spark 2 on the horizon. It looks like this is going to be a decent fit for what I need. I've been experiment…

> I would love to see an Opus-4.8-level local model but TBH I just haven't got there yet. The models I've tried so far _are_ good but they aren't able to solve tough technical challenges, regardless of harness/prompting/etc.

Agree. It doesn’t even have to be local, using models in this size class through OpenRouter will reveal their limits if you work side by side with Opus level models regularly.

There are a lot of social media posts about people cancelling their Anthropic or ChatGPT subscriptions after installing a local LLM. I’ve used local LLMs a lot and I spend a lot of time with frontier models and the difference is still huge. As far as I can tell, the social media posts about local LLMs replacing frontier models are either wishful thinking, engagement bait, or people who must be working on much simpler projects with a much higher tolerance for slop than I have.

Post reply on HN