GLM 5.2 beats Claude in our benchmarks • Hacker News Board

Re: GLM 5.2 beats Claude in our benchmarks

#71

Post by dist-epoch » Sun, Jun 28, 2026, 10:08 PM UTC

dakolli wrote: post #55

bArray wrote: post #37

Apparently GLM 5.2 is 753B parameters [1], what kind of hardware are people using to run this locally? [1] https://huggingface.co/zai-org/GLM-5.2

8 X RTX6000. It will run you around 80-100k to get started with a model at this size with decent tps.. Don't worry though, open source evangelists will tell you that these will be running on your phone in the next 3 years. For $100k you could run this model 24/7 through open router with 10 concurrent sessions at 50tps for a decade and have money left over for a vacation. There's no point in investing this type of mon…

> 50tps for a decade

assuming demand doesn't keep on increasing. even google has trouble having enough capacity apparently.

Re: GLM 5.2 beats Claude in our benchmarks

#72

Post by __MatrixMan__ » Sun, Jun 28, 2026, 10:08 PM UTC

g42gregory wrote: post #49

If only the "cybersecurity" crowd were focused on patching the vulnerabilities. Instead of shilling for the LLM providers.

But if we patch all of the vulnerabilities, who will pay for our vulnerability scanner?

Re: GLM 5.2 beats Claude in our benchmarks

#73

Post by [deleted] » Sun, Jun 28, 2026, 10:09 PM UTC

bArray wrote: post #37

Apparently GLM 5.2 is 753B parameters [1], what kind of hardware are people using to run this locally? [1] https://huggingface.co/zai-org/GLM-5.2

[deleted]

Re: GLM 5.2 beats Claude in our benchmarks

#74

Post by Aurornis » Sun, Jun 28, 2026, 10:10 PM UTC

dakolli wrote: post #55

bArray wrote: post #37

Apparently GLM 5.2 is 753B parameters [1], what kind of hardware are people using to run this locally? [1] https://huggingface.co/zai-org/GLM-5.2

8 X RTX6000. It will run you around 80-100k to get started with a model at this size with decent tps.. Don't worry though, open source evangelists will tell you that these will be running on your phone in the next 3 years. For $100k you could run this model 24/7 through open router with 10 concurrent sessions at 50tps for a decade and have money left over for a vacation. There's no point in investing this type of mon…

> 8 X RTX6000. It will run you around 80-100k to get started

8 x RTX6000 GPUs cost $100,000 alone. You then need to build a system that can support those GPUs with enough PCIe lanes through a PCIe switch.

It's going to be $120K to $150K to build or buy a system to run this.

Re: GLM 5.2 beats Claude in our benchmarks

#75

Post by pimeys » Sun, Jun 28, 2026, 10:11 PM UTC

HKCM852 wrote: post #65

pimeys wrote: post #59

I have taken another look on these open models after the fiasco of Fable and GPT 5.6 this weekend and... GLM-5.2 truly is a good workhorse model for daily programming. I consider myself a heavy user of LLMs and a seasoned developer. A typical session for me with GPT is usually over a hundred dollars... This weekend I programmed a matrix bot with encryption and a Rust agent with some tools. Because I need one and Open…

Which harness did u use?

Opencode and Zed about 40/60.

Re: GLM 5.2 beats Claude in our benchmarks

#76

Post by pimeys » Sun, Jun 28, 2026, 10:11 PM UTC

dist-epoch wrote: post #67

pimeys wrote: post #59

I have taken another look on these open models after the fiasco of Fable and GPT 5.6 this weekend and... GLM-5.2 truly is a good workhorse model for daily programming. I consider myself a heavy user of LLMs and a seasoned developer. A typical session for me with GPT is usually over a hundred dollars... This weekend I programmed a matrix bot with encryption and a Rust agent with some tools. Because I need one and Open…

$20 on API pricing or on subscription?

API, pay per token.

Re: GLM 5.2 beats Claude in our benchmarks

#77

Post by [deleted] » Sun, Jun 28, 2026, 10:12 PM UTC

solenoid0937 wrote: post #3

GLM export controls incoming? I predict Commerce will force OpenRouter, HuggingFace to take some open models down within the next few months. Not that it would make any sense.

[deleted]

Re: GLM 5.2 beats Claude in our benchmarks

#78

Post by laybak » Sun, Jun 28, 2026, 10:12 PM UTC

how representative are Semgrep's benchmarks? everyone seems to have their own benchmark these days (guess it's good "content marketing") I'm honestly losing track

Re: GLM 5.2 beats Claude in our benchmarks

#79

Post by [deleted] » Sun, Jun 28, 2026, 10:13 PM UTC

techpression wrote: post #56

Gigachad wrote: post #51

Earlier quoted context omitted.

Turns out toy drones are more useful in war than multi million dollar planes anyway.

Reaper and Predator are both drones and there’s really no comparison to toy drones in terms of sheer destruction and capabilities in general, the comparison is actually quite apt imo.

[deleted]

Re: GLM 5.2 beats Claude in our benchmarks

#80

Post by pimeys » Sun, Jun 28, 2026, 10:17 PM UTC

shostack wrote: post #69

pimeys wrote: post #59

I have taken another look on these open models after the fiasco of Fable and GPT 5.6 this weekend and... GLM-5.2 truly is a good workhorse model for daily programming. I consider myself a heavy user of LLMs and a seasoned developer. A typical session for me with GPT is usually over a hundred dollars... This weekend I programmed a matrix bot with encryption and a Rust agent with some tools. Because I need one and Open…

If you're using Matrix, consider Hermes as a harness if you haven't already. Native gateway support. I've been primarily using mine through Element and it has largely been great.

Oh interesting. I basically chose Matrix because setting anything up with Whatsapp or signal was kind of painful and telegram doesn't make it easy to use encryption with bots.

I kind of wanted to see if I can make a Matrix agent from scratch with Rust with GLM and it was surprisingly easy. Just make something for myself how I want it. Maybe I'll take a look on Hermes later...