Earlier quoted context omitted.
>such outrageous copyright infringement Sarcasm, considering the source of their own training data?
Considering they called the company "Misanthropic", sarcasm is a safe bet.
Somehow, I completely overlooked that.
GLM-5.2 is the new leading open weights model on Artificial Analysis
441–450 of 476 posts
Re: GLM-5.2 is the new leading open weights model on Artificial Analysis
#442Earlier quoted context omitted.
Are there any indications that this will be possible? Consumer hardware will continue getting better but I can't see 512GB RAM in a MacBook Pro any time soon. I'm hoping linear attention techniques plus MoE will make breakthroughs in size/compression and throughput.
In the last ten years laptop memory footprints have, what, doubled at the low end? Smallest MacBook Pro in 2016 was 8GB, smallest is 16GB today? Max I think has gone up 8x meanwhile, 16 to 128? I wonder if there's a bit of a chicken-and-egg issue where there wasn't much that demanded 10x the RAM, so there wasn't much pressure to develop more or increase production to support it at consumer prices. There's wayyyyyyy m…
The problem is that the situation in the RAM market might just... not go away. It's locked in for the next couple of years unless the AI market goes pop. Which it might! But if it doesn't, there's no particular reason to think that the incentives for cornering the market like OpenAI have would go away.
We might see that new normal in five years or so. We will see a new normal sooner than that if there's a run on AI because of the sudden availability of DRR fab capacity, but also we'll probably see the level of local models freeze at whatever state they've got to at that point. But an equally likely outcome is that any new DDR capacity that comes online is just immediately absorbed by frontier AI, and consumer devices stay at "just good enough" for a decade.
Re: GLM-5.2 is the new leading open weights model on Artificial Analysis
#443Earlier quoted context omitted.
> it's significant onboarding friction. It's crazy that apparently writing software without knowing how to edit a single config file is normal now.
For me it's about tolerance. When I was 13, I could and would customize everything, so much that the computer repair shop told my father that their son "likely is a hacker or something". At 40, I could easily configure claude code to use another model, even if there weren't any official guides with a bit of MITM fun, but I don't want to invest my attention / heavily use something that will most likely break in the ne…
You can ask the agent to change its own configs. Pi does that by default.
Re: GLM-5.2 is the new leading open weights model on Artificial Analysis
#444Earlier quoted context omitted.
IME, unquantised -> FP8 is pretty much lossless. What matters more is having an unquantized KV cache - using an FP8 KV cache can result in a significant drop in quality.
>unquantised -> FP8 is pretty much lossless Claude Shannon is rolling in his grave.
"Pretty much" doing a lot of work. But it's kinda analogous to 99% JPEG compression: yes you can detect loss, but you get meaningful compression ratios out of it and the subjective appearance is nigh-on perfect.
Shannon would be pointing out that if you can throw away half the model without apparent degradation, we're nowhere near packing in all the information we could in training. There must be a better arrangement than we've currently got.
Re: GLM-5.2 is the new leading open weights model on Artificial Analysis
#445Why aren't more people talking about this? It's literally Opus 4.7 quality stupid prices. I know providers who are offering this at unlimited tokens for $50 a month. Some are even offering API rates at 3x lower than the official ZAI api rates which are already like 10x cheaper than Opus. (Crof and Umans btw) This is a huge blow to Anthropic/OpenAI/Google and a massive win for the rest of the world. The official API p…
Which of those providers are: 1. Keeping your data private on in the US 2. Not training on it 3. Not quantizing the model 4. Offer reasonable latency adds rate limits
OpenRouter has a list of providers, looks like NovitaAI would meet those criteria. Though not for $50/mth for 80/M tokens, which I assume is the Z.ai subscription pricing.
Re: GLM-5.2 is the new leading open weights model on Artificial Analysis
#446Z-ai/GLM’s KV caching technology is truly impressive; the implicit cache hit rate of its official API exceeds 95%, far surpassing other APIs that support implicit caching, such as Gemini and Qwen. I’ve been pondering the architectural design behind this, though I haven't yet formed a fully coherent theory.
Re: GLM-5.2 is the new leading open weights model on Artificial Analysis
#447Earlier quoted context omitted.
Short comments... - GPT 5.5 consistently the best, an opinion who gets me constant downvotes here by the Anthropic Marketeer strike force... - China is going to eat the US lunch on AI - What have European universities and companies been doing? Its like if, on a parallel past/future, Nikola Tesla and Edison would have created flying Cyberpunk machines, while Europeans researchers, would be getting together to request…
To be honest, living in Switzerland and speaking with peers, we're just exhausted by the constant AI hype. For a lot of us, the fact that Europe isn't frantically trying to scrape the entire internet and every book in existence for the next massive model isn't a bad thing. The big players are doing their thing, like with the nuclear arms race. We regulate a lot, too much a lot of the time, but sometimes that trickles…
also living in Swizerland and I disagree. Hard.
it's horrible that Europe is so backwards in AI. too much regulation and nothing to show for it. we should be way faster.
there is no money. the culture in both Europe and Switzerland is that you don't fail, while in the US it's perfectly fine to be on your 4th startup because the first 3 failed.
it's not that it LOOKS slow and old fashioned, it IS slow and old fashioned. it's horrible.
Re: GLM-5.2 is the new leading open weights model on Artificial Analysis
#448Re: GLM-5.2 is the new leading open weights model on Artificial Analysis
#449why do not all open source LLM's have open weights like this model?
"open source" means that the code itself (for LLMs - this is training code) is available to the general public. "open weights" means that the weights (trained over time) are available publicly, rather than locked behind a paywalled chat. I do not know of an open source LLM that is not also open weights (unless they never bothered training it). Models like Claude and Gemini are neither open source, nor are they open w…
Got it, thanks for the thought
Re: GLM-5.2 is the new leading open weights model on Artificial Analysis
#450Earlier quoted context omitted.
> doesn't seem to take into account the cost savings from cache hits Absolute false information. From my usage panel for this month: * Total Tokens 1.1B * Cached Tokens 1.0B 97% of prompt tokens * Cost energy pricing $26.58 The energy pricing is higher then what i actually pay because its a mix of token billing and partial subscription (60% extra "power"). From the $50 subscription, i have about 3/4 left (4.21 of 16.…
Your reply doesn't seem to be in good faith. Please provide your formula for calculating effective per token cost. I am not sure why the small team argument is relevant. This is a crowded market, there are dozens if hundreds of third party inference providers in the world right now. I'm glad that's a good excuse that works on you but I'm not sure why the average user should care.
The formula is very easy. Go to the website of neuralwatt, and read ... 5$ = 1Kwh in power for non-subscription usage. For subscription usage you get ~50% more.
Then you actually use the service and see how much tokens you use on average. You calculate the token use vs what you pay. And this gives you a stable number to compare different services and model with, if you want the token cost. This is basic school level reasoning and calculation.
> I am not sure why the small team argument is relevant.
This is relevant to the previous poster his question regarding support and SLA/enterprise support.
> Your reply doesn't seem to be in good faith.... I'm glad that's a good excuse that works on you ...
Question: Do you have a issue with communicating with other people in real life?