Looks like China will lead the next generation of open source tech.
How is China training models without access to cutting edge GPUs?
They're being more efficient about it by the looks of things, rather than brute-forcing things...
A path to O1 open source
51–60 of 86 posts
Re: A path to O1 open source
#52It's ironic that they are attempting to open source a model from "OpenAI".
There is no moat for OpenAI. They spent a lot of money to find a lot of shallow gradients. Everyone else can climb those same gradients by putting in a little bit of money. Every single funded vertical and research org is proving this. Players in third place and below are incentivized to release their weights to develop an ecosystem around them. Meta and Tencent get to ensure the technology doesn't evolve beyond them…
They won’t because they drove away all their actually talent to Anthropic and elsewhere in pursuit of the dumbest version of SV product dev and are now forced to do benchmark hacking in a paper thin ruse to convince the market they still have the talent to compete. The o1 series models are unusable in practice while Claude and the new MCP protocol work is becoming the basis of a bunch of actually functional applications.
Re: A path to O1 open source
#53From the first few paragraphs it doesn't pass the sniff test for me.
"Now AI has made everything more complex!" "AI is embedded in everything we do"...
Sounds like marketing gibberish and obfuscation, combined with self promotion.
That's just my read at first sniff.
Re: A path to O1 open source
#54I don’t think anyone who upvoted this has read more than one sentence of this paper.
This paper has been available for a few weeks, and I wrote an article [1] exploring how to apply its inner workings to the design of multi-agent systems. If you can design "reasoning" at the model level, you can also design "reasoning" in larger, more complex systems using the same principles.
Re: A path to O1 open source
#55It seems to me that for the most capable and useful models, openness almost exclusively benefits businesses, or maybe academic organizations with money for serious hardware. I know what I can run on my 4090 at home but the results pale in comparison to the commercial services. I see why people consider these matters important from a theoretical standpoint but from a practical standpoint it doesn’t seem particularly c…
You can get cheaper hosting of open weights from a commercial provider than you can closed weights from the same company. So even if you’re not hosting yourself, openness is a major factor for price competitiveness.
Re: A path to O1 open source
#56Looks like China will lead the next generation of open source tech.
How is China training models without access to cutting edge GPUs?
They have access to cutting edge GPUs via rentals:
https://www.msn.com/en-us/money/markets/bytedance-plans-to-s...
Re: A path to O1 open source
#57Earlier quoted context omitted.
Yep, including HarmonyOS NEXT.
It is not open source. "HarmonyOS NEXT (Chinese: 鸿蒙星河版; pinyin: Hóngméng Xīnghébǎn) is a proprietary distributed operating system and a major iteration of HarmonyOS, developed by Huawei to support only HarmonyOS native apps." [0] https://en.wikipedia.org/wiki/HarmonyOS_NEXT
I am speculating it will become open source. or at least supplant Android's role in the global smartphone ecosystem.