No Hugging Face link yet. I wish they would release it under a true FOSS license. Kimi and QWEN are now moving on to a restricted-usage license, which, although is still better than the proprietary American models, is a step back from the open source Chinese LLM culture.
> No Hugging Face link yet. I wish they would release it under a true FOSS license.
GLM model weights have been released under MIT in the past, and there's no indication that this might change this time around.
People familiar with the topic, how will models continue to get better? Post training it seems? Labs have already used up internet-scale data, so are there any limits to architecture improvements and post training or can we expect this trend to continue? ByteDance is training a 10T-parameter model. Here, GLM 5.3 outperforms models 3-4x its size of roughly 700B, so parameter count doesn’t seem to be a direct correlati…
GitHub dumps are about 115 terabytes. The common crawl is in the petabyte range uncompressed for every year. Apparently there are dumps of Reddit too in spite of their efforts to ban bots and it's not solely due to the use of residential proxies. For a 1:20 parameter to token ratio, you can still train up to 10 trillion parameters so 10T parameters times 20 is about 200 trillion tokens. Then each token is 4 bytes so…
also reddit has eliminated their api entirely, but dumps of it can still be made. every website can be seen as its DOM with html, css, javascript, which can be seen as source code especially if you only look at its javascript, and its dom with css, html, javascript or only javascript can be added to a source code dump together with github and can be duplicated as plain text with no html markup, no css, no javascript, as an information source. if you pay youtube, instagram, tiktok, bilibili to crawl their data, you can probably get data into the exabyte range.
> Open Source: We will release the weights in two weeks after launch, once safety evaluation and hardening are complete. What safety evaluation? What safety hardening? They already evaluated it and found it to be highly capable at exploiting security vulnerabilities. So we know it is not "safe", and they don't seem to plan to do anything against it. What could be more dangerous than hacking? Biological weapons resear…
I wouldn't be surprised if more resources were put into abliteration resistance the more capable open weight models become. It's something you don't need at all to start hosting the model on your own, but something you need to take care of before you release the weights (if you do care about it at all).
This is going to be catastrophic. Whether AI works or is useful or not isn’t even the question anymore. It can fulfil every promise Sam Altman has been making and will still make no financial sense to justify these valuations.
I take it from [1] (transcript of recent DeepSeek CEO discussion with investors) that DeepSeek would disagree on the immediate catastrophic impact to the likes of OpenAI or Anthropic. The reason is even though technology parity mostly exists, only OpenAI, Anthropic et al have the inference capacity to gain market share and generate revenue. Chinese vendors don't have the chips needed to scale up inference and gain ma…
I would add that it is not just capacity, but also negotiation ability. With scale comes the ability to negotiate better prices than everyone else. Even if you can find capacity for your smallish user base, your inference cost can not match these companies unless you have a technical advantage for your inference cases. Squeezing the hardware requires request batching and caching which are far easier at scale and sustained user activity.
This is absolutely still shy of Sol and Fable, but only just by a hair. Ridiculous results. There's still not a compelling economic reason to drop OpenAI courtesy of the ludicrous reset addiction that's taken place, but it feels like we're on the precipice. How are you all toying with running this kind of thing in a mega quantized way locally? Two weeks out from released weights, but this is still just GLM 5.2 with p…
OpenAI and Anthropic are both seeking trillion IPOs, while Chinese labs are pumping out open-weight models that are free for US providers to host and monetize. These Chinese models cost less of US SOTA models to run, even if they are less capable. Providers can just run them, offer cheap tokens, and pocket the margin. I just don't see how you justify a trillion valuation for US AI labs when the underlying models are…
I’m in the Claude code harness for everything boat too. What are the alternatives?
ArtificialAnalysis puts out benchmarks for harnesses now as well, and OpenCode seems to be winning it. https://artificialanalysis.ai/agents/coding-agents#coding-ag... I only found this yesterday, and it inspired me to start testing out OpenCode.
Just a warning, this is on Opus. There's not a clear harness winner. It will change depending on the models.
I'm not surprised to also see Cursor above Claude code, their harness is very good.
In what scenarios?
It indexes the code efficiently, seems to find stuff quicker, it has a very nice UI (much better than Claude Codes IMO), it has a nice sub-agent UX which I find triggers more reliably, diffs render nicely. Otherwise it just seems to work in a purely vibes sense.
That said Claude Code is perfectly fine. I just prefer the integrated experience of using Cursors since I already use VSCode, but I still mostly use Claude Code because of their Max/Fable plan.
I bought $18 GLM official subscription yesterday (5.2, but new model version was already leaking on some docs), set it up with Claude Code harness... and I’ve bumped to $80 plan almost immediately. It’s the first model that agreed on a proper security research (red team scenario), executed it seamlessly, including 0-days in WP plugins, RCE, 6.8 kernel exploit adaptation, etc - while playing against another GLM agent…
Yes, I am tired of Claude and GPTs. I am ready to diversify my $300 per month on other vendors. Will try GLM. How was your rate limits and availability experience on $80 dollar plan?
It’s comparable to Anthropic usage, to be honest. 2x GLM agents ate 18% of weekly usage on this mid-tier plan within ~8 hrs (non-stop work, a lot of tool calls, appx 4 compactions each), I think. I didn’t make a proper statistics snapshot, sorry.
what i appreciate most about this post is the level of transparency in how they built and scaled an RL pipeline. my friends at the big labs are so cagey about everything, and Zai is just putting out a great crash course for free.