I hope the competition among AI companies will continue to be healthy. Meaning they will keep sharing their techniques and papers, and we, as a whole, will be better off.
Deepseek: The quiet giant leading China’s AI race
21–30 of 476 posts
Re: Deepseek: The quiet giant leading China’s AI race
#22I feel the GPU restrictions created an environment for Chinese Devs to be more innovative and do more with less. Kudos to the deepseek team!
Kai-Fu Lee describes the culture so well in AI Superpowers. The roots are well before GPU restriction. Absolute cut throat competition. Imagine Sam Altman throwing a chair out a window in a meeting lol. The message of AI Superpowers is that China will lag the US at first but once things stabilize this will happen because China has a lot more engineers and a lot more data. Anyone who hasn't read AI Superpowers should…
I don't know, I've been hearing the story that China is about to upend the US as the leading global superpower ever since I was a kid. There's always a new vogue and novel twist put on the rationale and how it's gonna happen, but so far it's like fusion, always a few years away.
Re: Deepseek: The quiet giant leading China’s AI race
#23I find that the gushing around deepseek is fascinating to watch. To me there are a few structural and fundamental reasons why deepseek can never outperform other models by a wide margin. On par maybe--as we reach the diminishing returns with our investment in the models, but not win by a wide margin. 1. The US trade war with china which will place deepseek compute availability at disadvantages, eventually, if we ever…
[flagged]
Re: Deepseek: The quiet giant leading China’s AI race
#24I find that the gushing around deepseek is fascinating to watch. To me there are a few structural and fundamental reasons why deepseek can never outperform other models by a wide margin. On par maybe--as we reach the diminishing returns with our investment in the models, but not win by a wide margin. 1. The US trade war with china which will place deepseek compute availability at disadvantages, eventually, if we ever…
deepseek doesn't need to outperform other models, it just needs to be cheap, or, efficient
the cost of deepseek (if it's true) will disrupt the logic of current AI industry
The current AI industry is built on a financing bubble, where investors hand over money blindly without demanding that companies profit from AI. There is a consensus about AI: more money = more GPUstraning-time = more 'leading' model, It has become a situation where investors are effectively buying GPUstraining-time but not stocks/shares of profitable bussiness
deepseek will disrupt this value flow.
> Alibaba Cloud announced the third round of price cuts for its large models this year, with the visual understanding models of the General Qwen-VL models experiencing a price reduction of over 80% across the board. The Qwen-VL-Plus model saw a direct price drop of 81%, with the input cost being only 0.0015 yuan per thousand tokens, setting a record for the lowest price across the network. The higher-performance Qwen-VL-Max model was reduced to 0.003 yuan per thousand tokens, with a significant decrease of 85%. According to the latest prices, one yuan can process up to approximately 600 720P images or 1700 480P images.
Re: Deepseek: The quiet giant leading China’s AI race
#25Earlier quoted context omitted.
>I want to know exactly what makes everyone thinks that deepseek totally owns the LLM space? It achieved competitive performance to the competition at literally 10x less cost of production (training). That's an incredible achievement in any industry, especially given they have such a small team relative to competitors. Their API is 20-50x cheaper than the competitors, and not because they're burning cash by charging…
Of course if you arrive last and copy all the existing architecture you can train it cheaper
No, you can only train at the same cost then. (Actually higher, because you don't have the existing hardware/power agreements) The whole point of the last model was that they made significant changes beyond just copying.
Re: Deepseek: The quiet giant leading China’s AI race
#26Earlier quoted context omitted.
Kai-Fu Lee describes the culture so well in AI Superpowers. The roots are well before GPU restriction. Absolute cut throat competition. Imagine Sam Altman throwing a chair out a window in a meeting lol. The message of AI Superpowers is that China will lag the US at first but once things stabilize this will happen because China has a lot more engineers and a lot more data. Anyone who hasn't read AI Superpowers should…
I don't know, I've been hearing the story that China is about to upend the US as the leading global superpower ever since I was a kid. There's always a new vogue and novel twist put on the rationale and how it's gonna happen, but so far it's like fusion, always a few years away.
I think you mean nuclear fusion.
Re: Deepseek: The quiet giant leading China’s AI race
#27I find that the gushing around deepseek is fascinating to watch. To me there are a few structural and fundamental reasons why deepseek can never outperform other models by a wide margin. On par maybe--as we reach the diminishing returns with our investment in the models, but not win by a wide margin. 1. The US trade war with china which will place deepseek compute availability at disadvantages, eventually, if we ever…
> ... why deepseek can never outperform ... This read more like a "western supremacists" post. 1. Only until China produces more compute than the west. 2. You don't have to ask ChatGPT / Claude many questions before realizing the grave censorship these are under - DeepSeek has access the roughly the same corpus of data as their western counter parts. 3. It is naive to think they only develop open source or will not s…
Curious to hear more about the grave censorship that ChatGPT and Claude are under. Specifically where non-western models are not.
Re: Deepseek: The quiet giant leading China’s AI race
#28Earlier quoted context omitted.
Kai-Fu Lee describes the culture so well in AI Superpowers. The roots are well before GPU restriction. Absolute cut throat competition. Imagine Sam Altman throwing a chair out a window in a meeting lol. The message of AI Superpowers is that China will lag the US at first but once things stabilize this will happen because China has a lot more engineers and a lot more data. Anyone who hasn't read AI Superpowers should…
I don't know, I've been hearing the story that China is about to upend the US as the leading global superpower ever since I was a kid. There's always a new vogue and novel twist put on the rationale and how it's gonna happen, but so far it's like fusion, always a few years away.
What makes you think it has not happened? There has not been an event to establish who the current super power is in new time.
Re: Deepseek: The quiet giant leading China’s AI race
#29Earlier quoted context omitted.
Kai-Fu Lee describes the culture so well in AI Superpowers. The roots are well before GPU restriction. Absolute cut throat competition. Imagine Sam Altman throwing a chair out a window in a meeting lol. The message of AI Superpowers is that China will lag the US at first but once things stabilize this will happen because China has a lot more engineers and a lot more data. Anyone who hasn't read AI Superpowers should…
I don't know, I've been hearing the story that China is about to upend the US as the leading global superpower ever since I was a kid. There's always a new vogue and novel twist put on the rationale and how it's gonna happen, but so far it's like fusion, always a few years away.
[deleted]
Re: Deepseek: The quiet giant leading China’s AI race
#30Earlier quoted context omitted.
>I want to know exactly what makes everyone thinks that deepseek totally owns the LLM space? It achieved competitive performance to the competition at literally 10x less cost of production (training). That's an incredible achievement in any industry, especially given they have such a small team relative to competitors. Their API is 20-50x cheaper than the competitors, and not because they're burning cash by charging…
But like I said, deepseek is open source so why can't the competitors copy whatever source that makes the cost of production 10x cheaper ?
You have to distinguish between the current model and DeepSeek the company. DeepSeek the company can do an OpenAI and stop releasing their weights any time they like. The knowledge and skill is retained.
I really wonder how long the current era of giving models away for free can last. How is this sensible from a business perspective? Facebook got burned by iOS and now engage in what would otherwise look like irrational behavior to avoid being locked into a supplier again, but even then, they don't really need to give Llama away for free. They could train and use it for themselves just fine.