351–360 of 544 posts
From a very subjective KingBench v3 https://www.youtube.com/watch?v=MkFThJWJgg8, the results are promising. Curious for more standardized results as well. And for Simmon's pelican.
Okay so if this model is half a year behind, so let’s say January opus pre-nerf, this is it. Inference is actually quite cheap for token costs, the frontier labs burn most of their money on training new models, priced into their token costs ontop of some margins and paying record salaries. So if this goes open, distills are tried out, independent providers around the world host it with actual price competition, the h…
Quit my Claude pro subscription last week and purchased credits for an API inference provider. I think I might even end up saving money, since I really don’t use AI that much, and I actually found that gemma4:31b is fine for most of my non-coding inquiries.
Apparently this isn’t OpenGL Mathematics the C++ library I expected.
It's great that we are getting so many open source model releases, but I just feel like SOTA models will always be in the hands of the big players. The hardware requirement to achieve SOTA are just too steep. My alternate universe would involve some sort of decentralized investing scheme to build data centers running massive open source models that could compete on some level with Anthropic, OpenAI, etc.
Do we really care about this gap? If open models are 6 months to a year behind frontier models, does it really matter that much?
Given the US government’s latest stunt with Fable, this is looking more and more like the future. Can’t rely on strategic products if they’re gated by capricious actors. Open weight models are basically immune to that
> Open weight models are basically immune to that Somewhat. The US Gov can make it illegal to transact with, download, use, etc. foreign open weight models. Of course, enforcement will be difficult for individuals (businesses will comply by default, and they would all be pulled off Github and other US based hosting locations if they went the sanctions route). But, we are also quickly going down the road of frightenin…
Presumably you mean in the USA (otherwise foreign means nothing)
I don’t think this stands for General Linear Model.
Earlier quoted context omitted.
It's really not that complicated. The government banned people from trading causing extreme poverty and famine in one of the most fertile areas in the world. Then they reversed the ban and let Chinese people trade again. At the same time western companies setup factories in China causing massive capital inflows.
If it's really as simple as allowing trade with the west then why are many other developing countries either stuck at the middle-income trap or not developing quite as fast as China? You're not gonna tell me Chinese are smarter, are you?
"You're not gonna tell me Chinese are smarter, are you?" No I'm not, but I will say culture does play a massive role, China was not a bunch of roaming tribes living off the land. Turn the clock back a couple of hundred years and it would be peak civilisation. China was literally thousands and thousands of years ahead of somewhere like North Sentinel island.
Calling China a developing country is actually pretty absurd, it's much more like a rebuilding country. GDP was the only undeveloped part because the communist party was terrible at running the economy. Art, science, poetry, fashion, literature, philosophy, culinary arts it was all present and pretty cutting edge up until the communist party ruined things.
It's the same reason Japan, German and the UK bounced back after WW2 except instead of it being war ( Japanese invasion and Chinese civil war aside ) it was self inflicted.
Also I don't think China has escaped the middle income trap. China to this day has horrible wealth inequality and pretty bad social mobility. I actually think this is an intentional strategy they have an underclass of cheap workers for a reason, the government doesn't force a high minimum wage for a reason. Then they have a rich upper class that gets to study in the west and buy a Porsche something that is completely unreachable for the rest of the country.
Earlier quoted context omitted.
Looks like it's about a year behind. Not that I am complaining. A year behind is good progress. I also feel much of the trick is in the reasoning and harness. so some progress around that would accelerate this process.
Harness certainly matters a lot, though GLM is pretty forgiving. I just had Opus tell me that based on numbers over the last week, from quite a few billion tokens total across half a dozen providers, GLM 5. 1 has been more reliable for one of my projects than Sonnet... Just switching on 5.2 now.
In the last few days, Chinese labs have given us MiniMaxM3, KimiK2.7 and now GLM5.2. Meanwhile US is censoring models. Reads like fiction.
I don’t understand how I grew up thinking USA is the gold standard is good and China just make cheap copies and is bad. But these news really changes my view on China and USA. I can’t believe it almost.
You did not grow up in the 80s ... Where it was the same about US vs Japan. Look how it turned out for several of the US industries. The US tends to sleep, look down on other countries, and then it loses key industries because of that attitude.
Seems like there's no official blog post with benchmark results yet. But I'm once again thankful for the Chinese AI labs for being open with their work and contributing it to the world under permissive licenses like this. The Fable 5 fiasco is just another reminder of how valuable these things are to have.
It's also a reminder that as soon as Chinese models take the lead, they will switch to closed source too... so let's not be complacent, we need stronger, completely open data models, open source code, etc. to mitigate this risk
What specifically about their release strategy “reminded” you of that conjecture?
The premise that they only open source the models … because it somehow helps them leapfrog American labs, and once they actually can leapfrog them, they’d close source them, doesn’t really track for me. Am I missing something?
I mean I think we need our own domestic open weight labs. I just don’t particularly understand the point you’re making