Anyone has a link to a report of its capabilities? I can't find a reliable source.
63% at DeepSWE.
https://x.com/davis7/status/2091285712566140986
Wenghi is behind DeepSWE, one of the best benchmarks.
Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
81–90 of 151 posts
Re: Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
#82I had Ox Alpha working on coding tasks for a couple days non-stop, via OpenRouter and OpenCode Zen. Crush harness. It was able to complete tasks at a level that I'd put between Sonnet and Opus. It makes few mistakes, but is not that smart. The main issue for me, is that it degraded into a doom loop several times. One of them was running the same bash command about a thousand times. The last model I've used that had t…
I usually see doom loops when working with quants. Likely theyre trying to maximize the viability of a efficient model quant that can bw upgraded. Like cutting coke to get crack, quantiry over quality.
Nit pick; cutting (adulterating) cocaine doesn't produce crack cocaine.
Re: Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
#83I had Ox Alpha working on coding tasks for a couple days non-stop, via OpenRouter and OpenCode Zen. Crush harness. It was able to complete tasks at a level that I'd put between Sonnet and Opus. It makes few mistakes, but is not that smart. The main issue for me, is that it degraded into a doom loop several times. One of them was running the same bash command about a thousand times. The last model I've used that had t…
I usually see doom loops when working with quants. Likely theyre trying to maximize the viability of a efficient model quant that can bw upgraded. Like cutting coke to get crack, quantiry over quality.
Ox alpha at moments felt like it was quantized to hell. I think the last few days it might have improved.
Re: Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
#84Calling it now: The big deal about this model is the sheer volume they were offering through openrouter and OpenCode. How? Chinese AI accelerators / nvidia-free stack
Re: Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
#85Mixed signals, here it's performing below even GPT-5.4 Nano: https://livebench.ai/ while here it outperforms Fable by a significant margin: https://oxalpha.com/ but if the latter is true, will people still say it was "distilled" from Fable?
Kinda useless to compare simply based on model without considering harness. Different agents handle the context etc completely differently. I would like to start seeing these model vs model comparisons across different harnesses.
Re: Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
#86Ox alpha is better at UI than GPT 5.6 Sol. Not a high bar considering Sol sucks at UI, but as someone who just has a codex sub, I've used almost 1B tokens of ox alpha these last few days to complement Sol smartness.
Inference was atrocious in terms of speed and constant timeouts. If it's served fast it will be a delight to use.
Re: Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
#87I had Ox Alpha working on coding tasks for a couple days non-stop, via OpenRouter and OpenCode Zen. Crush harness. It was able to complete tasks at a level that I'd put between Sonnet and Opus. It makes few mistakes, but is not that smart. The main issue for me, is that it degraded into a doom loop several times. One of them was running the same bash command about a thousand times. The last model I've used that had t…
I couldn't get past all the network errors on OpenCode. Seemed smart enough, and was useful when I was low on usage on Claude, but beyond that, really hard for me to say whether it was Good or Bad.
Re: Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
#88Mixed signals, here it's performing below even GPT-5.4 Nano: https://livebench.ai/ while here it outperforms Fable by a significant margin: https://oxalpha.com/ but if the latter is true, will people still say it was "distilled" from Fable?
Claims about Ox Alpha performing at Fable level were from the social media hype cycle. Everything new in the LLM space brings a wave of influencers hyping it up as a revolutionary leap forward. Don’t forget to like and subscribe to learn more. It is a capable small model, but it’s not frontier level. The interesting part will be seeing the model size, how it responds to quantization, and how fast it runs on the kind…
This influencers are getting paid, it's not coincidential.
Re: Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
#89Earlier quoted context omitted.
Two potentials from my pov: 1. Just variance in pass@K. If you prompt any model multiple times you'll see a large variance. N=1, but I find chinese open source models have a higher variance than higher-RL'd models like fable/opus. 2. They legitimately shipped a new RL checkpoint over the 7 days, which I find hard to believe. I am leaning towards 1.
3. Deployment problems unrelated to the weights causing degraded performance
For sure the version accessible from OpenCode had a massive timeout problem the first day or so, which seemed to heavily degrade its task completion rate
Re: Z.ai confirms Ox Alpha is a new GLM-series model and will release its weights
#90Earlier quoted context omitted.
I really want to see hard evidence of distillation before I buy into it. Seems like a lot of sour grapes over not having the sort of lead assumed. In this field, it has been shown repeatedly that leaps in performance come swiftly and without notice.
FWIW, the way GLM-5.2 (and 5.3) talk is clearly claude, so it is for sure also trained using distillation. The metric used there is me screaming at my screen per operating hours. Does it matter? IMO not really. Weights are open after all. (Or.. soon at least for 5.3)
With the amount of Claudish on the internet now, and in source code repositories (how many Claudish README.mds have you seen?), you don't have to make a single API call to end up with a model that talks like Claude.
And critically, like contracts in general, Anthropic's terms of service is only binding upon the user/counterparty. So even if a company say specifically sought out 'claude-like' content, and claude code traces available on the internet, if they don't use the Anthropic platform there is no ToS claim.