Zuckerberg should stop claiming Meta is open sourcing AI (they are even running TV ads) when they are only releasing the weights, and not the code. Only DeepSeek is real OSS AI.
DeepSeek open source DeepEP – library for MoE training and Inference
51–60 of 77 posts
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#52Zuckerberg should stop claiming Meta is open sourcing AI (they are even running TV ads) when they are only releasing the weights, and not the code. Only DeepSeek is real OSS AI.
Well technically even DeepSeek is not as OSS as OLMo or Open Euro, because they didn't open the data.
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#53Zuckerberg should stop claiming Meta is open sourcing AI (they are even running TV ads) when they are only releasing the weights, and not the code. Only DeepSeek is real OSS AI.
Well technically even DeepSeek is not as OSS as OLMo or Open Euro, because they didn't open the data.
For understandable reasons
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#54Earlier quoted context omitted.
That’s an impossible ask. Sam is the pinnacle of capitalist ruling class, he’s a pure businessman. He has no interest in giving anything for free unless there’s a business plan. He doesn’t care about humanity. He’ll pretend to change the world and tell you that they’re inventing AGI, Q*, strawberry or whatever they’re branding it, but the reality is he knows it’s all over and unless there’s a major breakthrough this…
Their state-of-the-art speech to text model, Whisper, is available as open weights for free.
Strategically, they know that needs to run at the edge, and they want users to send them requests to their API without incurring latency or bad user experience.
That is still a fair point, though, and it should be commended. And that hasn't been their only contribution, either.
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#55Zuckerberg should stop claiming Meta is open sourcing AI (they are even running TV ads) when they are only releasing the weights, and not the code. Only DeepSeek is real OSS AI.
Open Weights = Binary Blob
It's a return to the FREEWARE / SHAREWARE model.
This is the language we need to use for "open" weights.
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#56Zuckerberg should stop claiming Meta is open sourcing AI (they are even running TV ads) when they are only releasing the weights, and not the code. Only DeepSeek is real OSS AI.
Well technically even DeepSeek is not as OSS as OLMo or Open Euro, because they didn't open the data.
We're 2/3rds of the way there.
We need:
1. Open datasets for pretrains, including the tooling used to label and maintain
2. Open model, training, and inference code. Ideally with the research paper that guides the understanding of the approach and results. (Typically we have the latter, but I've seen some cases where that's omitted.)
3. Open pretrained foundation model weights, fine tunes, etc.
Open AI = Data + Code + Paper + Weights
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#57You gotta love these guys, they're really pushing the open source frontier for all of us, thanks for sharing
[dead]
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#58You gotta love these guys, they're really pushing the open source frontier for all of us, thanks for sharing
Open AI™ (with a space)
There's hilariously nothing open about OpenAI, and that was the plan from the start. From the email by Ilya Sutsekver, OpenAI was always going to keep all it's research and code as proprietary information. Open supposedly meant the benefits would be shared. So they basically just became a SaaS with a free tier, like most of them. Musk was right when he called them out for fishing for money as if they were a non profit, but always had plans to become a company
Re: DeepSeek open source DeepEP – library for MoE training and Inference
#59Zuckerberg should stop claiming Meta is open sourcing AI (they are even running TV ads) when they are only releasing the weights, and not the code. Only DeepSeek is real OSS AI.
does pytorch count