GLM-5.3 Artificial Analysis Benchmarks

lisplist wrote: post #3

colingauvin wrote: post #2

...do I take out a double mortgage to buy a 4 Spark cluster?

$20k is personal loan territory, not a second mortgage lol

Not with my credit!

Re: GLM-5.3 Artificial Analysis Benchmarks

#5

Post by markasoftware » Tue, Aug 18, 2026, 11:09 PM UTC

Very impressive score for the size, though token use is higher than k3 and far higher than proprietary models, and its price to performance isn't all that far ahead of k3 as a result

Re: GLM-5.3 Artificial Analysis Benchmarks

#6

Post by nvme0n1p1 » Tue, Aug 18, 2026, 11:17 PM UTC

colingauvin wrote: post #2

...do I take out a double mortgage to buy a 4 Spark cluster?

No, you use openrouter and spend 10% as much as using a proprietary model.

Re: GLM-5.3 Artificial Analysis Benchmarks

#7

Post by Zaheer » Tue, Aug 18, 2026, 11:18 PM UTC

Is it worth using these models if I have a claude code subscription already? The appeal of lower cost is nice but I haven't gotten over the switching cost yet.

Re: GLM-5.3 Artificial Analysis Benchmarks

#8

Post by Havoc » Tue, Aug 18, 2026, 11:18 PM UTC

markasoftware wrote: post #5

Very impressive score for the size, though token use is higher than k3 and far higher than proprietary models, and its price to performance isn't all that far ahead of k3 as a result

>token use is higher than k3 and far higher than proprietary models

GLM sets effort to max by default historically.

Re: GLM-5.3 Artificial Analysis Benchmarks

#9

Post by scotttrinh » Tue, Aug 18, 2026, 11:20 PM UTC

I like to compare models with a similar score on cost per task and output tokens per task since those measure two things I'm interested in: cost efficiency and token efficiency. Here's how GLM-5.3 compares to other models in a similar score and against GLM-5.2 to save a few clicks for others who care about these metrics:

    Model                        Score    Cost / Task    Output Tokens / Task
    -------------------------------------------------------------------------
    GLM-5.3 (max)                 59.5          $0.68                  41,107
    GLM-5.2 (max)                 53.0          $0.56                  32,200
    Claude Opus 5 (high)          61.5          $1.52                  21,353
    GPT-5.6 Sol (max)             60.9          $1.23                  16,879
    Grok 4.6 (high)               60.9          $0.84                  21,735
    Kimi K3 (max)                 59.7          $0.84                  25,474
    GPT-5.6 Sol (xhigh)           59.0          $0.87                  11,098
    Claude Opus 5 (medium)        58.6          $0.98                  12,459
    Qwen3.8 Max                   58.1          $1.13                  38,287
    Qwen3.8 2.4T A95B             57.7          $0.95                  32,472
    Claude Opus 4.8 (max)         57.3          $1.65                  33,557
    GPT-5.6 Sol (high)            57.3          $0.52                   7,545
    Muse Spark 1.2 (xhigh)        56.8          $0.40                  30,430
    GPT-5.6 Terra (max)           56.6          $0.51                  20,838
    GPT-5.5 (xhigh)               56.3          $0.69                  16,893
    Gemini 3.7 Flash (high)       56.0          $0.40                  36,847

Edited for accuracy and more models.

Re: GLM-5.3 Artificial Analysis Benchmarks

#10

Post by colingauvin » Tue, Aug 18, 2026, 11:21 PM UTC

Zaheer wrote: post #7

Is it worth using these models if I have a claude code subscription already? The appeal of lower cost is nice but I haven't gotten over the switching cost yet.

At least by API usage, they aren't yet lower cost than subscriptions. Not sure about GLM's subscription plans though.