> Starting next week, we'll open-source 5 repos – one daily drop Probably counts as announcement of announcement? Let’s wait for the actual repo drops before discussing them, especially because there are no details about what will be open sourced other than > These are humble building blocks of our online service: documented, deployed and battle-tested in production.
On a completely innocuous side note, I kind of like to see the ´drop´ language used by electronic dance music and hip hop producers used in software.
DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
51–60 of 268 posts
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#52Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#53Earlier quoted context omitted.
Well, it’s a highly effective PR tactic that works well for the small fish. You say your competition is too selfish and you just want to help people and it creates a bunch of goodwill you can use to grow. Once you grow, your view on things changes, and you’re able to be more selfish. It’s not guaranteed things will go that way, but it’s certainly true that this is a good PR tactic for new entrants in to a crowded fie…
[flagged]
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#54Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#55Deepseek seems to be having huge PR wins as the "oh shucks" modest boy genius, while the Americans seem like pouty jerks. Amodei's / Hassabis' comments in particular came off as so arrogant and annoying.
Exactly which part of their writings comes off as arrogant to you? The only point in Amodei's article[0] that could be remotely be interpreted as arrogant is this:
All of this is to say that DeepSeek-V3 is not a unique breakthrough or something that fundamentally changes the economics of LLM’s; it’s an expected point on an ongoing cost reduction curve. What’s different this time is that the company that was first to demonstrate the expected cost reductions was Chinese.
Maybe I'm different, but it really does sound reasonable judgement to me.[0]: https://darioamodei.com/on-deepseek-and-export-controls#deep...
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#56Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#57Kinda interesting to see where the moat is in AI space. Good base models can always distilled when you have access to API. System prompts can get leaked, and UI tricks can be copied. In the end, the moat might be in the hardware and vertical integration.
The moat is the products that can be built. The moat is always the product - because a differentiated product can't be a commodity. And an LLM is not a product.
Google and MSFT and Meta have already "won" because they have profitable products they can build LLMs onto. Every other company seems to be burning cash to build a product, and only ChatGPT is getting the brand recognition to realistically compete.
Building an LLM is like building a database. Sure a good one unlocks new uses, but consumers aren't buying something for the database. Meanwhile enterprise customers will shop around and drive the price of a commodity down while open source alternatives grow from in-house uses to destroy moats.
Even hardware isn't a true moat. Only Google has strong vertical integration with their TPUs, and that gives them a lead. BUT Microsoft, AWS, Meta and a whole bunch of startups are building out custom silicon which will surely put pressure on them and Nvidia to keep innovating and earning that price edge.
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#58Long live llms I hope they infest every part of the internet with low level comments. Both the clear , deep, and dark. Imagine no more human interactions just a permanent flood of meaningless thoughtless word salad. I think the Chinese are perfect to introduce such a product very inline with what they usually produce. Get ready for web3.o
Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#59Re: DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days
#60Earlier quoted context omitted.
Well, it’s a highly effective PR tactic that works well for the small fish. You say your competition is too selfish and you just want to help people and it creates a bunch of goodwill you can use to grow. Once you grow, your view on things changes, and you’re able to be more selfish. It’s not guaranteed things will go that way, but it’s certainly true that this is a good PR tactic for new entrants in to a crowded fie…
[flagged]