I really admire their mindset of striving for the betterment of humanity. There was a time when OpenAI, Anthropic, and even Musk used to talk with that same lofty vision. But now, they've all shifted to competing for national interests instead, which is honestly quite disappointing.
DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
41–50 of 268 posts
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#42Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#43“Pure garage-energy” is a great phrase. Most interested to see their inference stack, hope that’s one of the 5. I think most people are running R1 on a single H200 node but Deepseek had much lower RAM per GPU for their inference and so had some cluster based MoE deployment.
“Pure garage-energy” with 10,000 A100s, apparently. I’d love to have a garage like that.
> We believe DeepSeek has access to around 10,000 of these H800s and about 10,000 H100s. Furthermore they have orders for many more H20’s, with Nvidia having produced over 1 million of the China specific GPU in the last 9 months.
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#44“Pure garage-energy” is a great phrase. Most interested to see their inference stack, hope that’s one of the 5. I think most people are running R1 on a single H200 node but Deepseek had much lower RAM per GPU for their inference and so had some cluster based MoE deployment.
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#45Amodei's / Hassabis' comments in particular came off as so arrogant and annoying.
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#46I really admire their mindset of striving for the betterment of humanity. There was a time when OpenAI, Anthropic, and even Musk used to talk with that same lofty vision. But now, they've all shifted to competing for national interests instead, which is honestly quite disappointing.
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#47“Pure garage-energy” is a great phrase. Most interested to see their inference stack, hope that’s one of the 5. I think most people are running R1 on a single H200 node but Deepseek had much lower RAM per GPU for their inference and so had some cluster based MoE deployment.
[flagged]
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#48> Starting next week, we'll open-source 5 repos – one daily drop Probably counts as announcement of announcement? Let’s wait for the actual repo drops before discussing them, especially because there are no details about what will be open sourced other than > These are humble building blocks of our online service: documented, deployed and battle-tested in production.
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#49I really like this definition of "AGI": When everyone (yes everyone) benefits from very powerful AI models released for free and it is not gate-kept by one company and it costs $0 to use commercially or for research and you can do whatever you want with it. Unlike the other counterpart which believes that "AGI" means: "raising billions of dollars to achieve $100BN of profits to their investors". (Which is complete no…
You’re assuming they won’t follow in OpenAI’s footsteps. OpenAI published a lot for a while and truly changed the world, far more than deepseek has. Only time will tell. But I think it’d be a mistake to think that this is necessarily beneficial for humanity just because the weights are open. It’s maybe great to commoditize models, but their displacement in jobs, original thought and work, facilitation of disinformati…
So it doesn't matter when there are multiple players competing to destroy each others in this race to zero.
> But I think it’d be a mistake to think that this is necessarily beneficial for humanity just because the weights are open. It’s maybe great to commoditize models, but their displacement in jobs, original thought and work, facilitation of disinformation and population psychological warfare doesn’t change… if anything it’s accelerated and harder to temper the bad elements.
It is unrealistic to close it up and hope that no-one catches up and releases a better AI model for free since the cat's already out of the bag and the progress of these AI models cannot be delayed, stopped or gate-kept for long.
By that time, someone will release a more powerful AI model for free.
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#50Earlier quoted context omitted.
Well, it’s a highly effective PR tactic that works well for the small fish. You say your competition is too selfish and you just want to help people and it creates a bunch of goodwill you can use to grow. Once you grow, your view on things changes, and you’re able to be more selfish. It’s not guaranteed things will go that way, but it’s certainly true that this is a good PR tactic for new entrants in to a crowded fie…
From what I know, DeepSeek is a small company that made a lot of money from other businesses, which makes their lack of focus on commercial interests feel more genuine. Plus, even back when they were relatively unknown, they had a habit of donating over $100 million annually to charitable causes. That makes their claim of striving for humanity a lot more believable.
Google also made a lot of money from other businesses that aren't AI models, until they started selling AI models, just as DeepSeek now does.
The reality is that DeepSeek is a full company, that was funded as a spin-off from the original business (a hedge fund that used its large GPU stockpile to pick stocks via ML). The company DeepSeek is owned by the hedge fund CEO not the hedge fund. It exists as a business aiming to make money, not as a pet project for another business.