GLM-5.3-Flash

epolanski wrote: post #4

I'm starting to think that this whole sanctioning China may motivate and prompt them to do more and better in every field. It's too big, bright and resourceful of a country to choose confrontation instead of collaboration.

This has been clearly stated as what would happen going back several decades at least.

Re: GLM-5.3-Flash

#7

Post by mmastrac » Wed, Aug 26, 2026, 2:20 PM UTC

Weights on HF here: https://huggingface.co/zai-org/GLM-5.3-Flash

I decided to take the plunge and get myself four sparks at a decent price (and bought the QSFP cables from AliExpress because they are literally 1/2 the price of Amazon), even knowing Apple was going to release new hardware and there's probably a spark 2 on the horizon. It looks like this is going to be a decent fit for what I need. I've been experimenting with a two-node DS4 and it's _good_ at some tasks, but it really just spins its wheels when it hits the limit of what it can reason through.

I can offload mundane/basic tasks to DS4 on two sparks, but I've been pushing it harder on some novel work and it just can't run on its own at all beyond a certain complexity level.

I would love to see an Opus-4.8-level local model but TBH I just haven't got there yet. The models I've tried so far _are_ good but they aren't able to solve tough technical challenges, regardless of harness/prompting/etc.

Re: GLM-5.3-Flash

#8

Post by Xunjin » Wed, Aug 26, 2026, 2:20 PM UTC

iamsyr wrote: post #3

Standard API Pricing for GLM-5.3-Flash (per 1M tokens) - Input: $0.15 - Output: $0.50 - Cached input: $0.03

Is that cheaper than DS4 flash?

Re: GLM-5.3-Flash

#9

Post by packetlost » Wed, Aug 26, 2026, 2:20 PM UTC

For those who didn't read, this is the identity of the mysterious "Ox Alpha" model

Re: GLM-5.3-Flash

#10

Post by revolvingthrow » Wed, Aug 26, 2026, 2:21 PM UTC

> 320B total parameters and just 18B active parameters

This is pretty hefty for a "flash" model, even a 256 GB setup is insufficient at q4 - and q4 is already the worst-but-still-acceptable quant in my experience. The benchmarks look great, especially since GLM tends to be more honest than the average Chinese lab, but you’ll need to splurge to run it at home.

@edit: so many releases that I forgot to math. This fits just fine in q4, realistically the minimal hardware would be 192gb - so blazing fast on double rtx 6000 pro and usable on 256gb unified memory. You could even go with 5bit quant on 256gb.

… you’ll still need to splurge, though.