Deepseek: The quiet giant leading China’s AI race

Post by kayewiggin » Tue, Dec 31, 2024, 7:27 PM UTC

HarHarVeryFunny wrote: post #125

nsoonhui wrote: post #13

I find that the gushing around deepseek is fascinating to watch. To me there are a few structural and fundamental reasons why deepseek can never outperform other models by a wide margin. On par maybe--as we reach the diminishing returns with our investment in the models, but not win by a wide margin. 1. The US trade war with china which will place deepseek compute availability at disadvantages, eventually, if we ever…

> The US trade war with china which will place deepseek compute availability at disadvantages I doubt it'll make much difference. Right now there is a US technology embargo on GPU sales to China above a certain performance level, but this has been worked around in various ways and doesn't seem to have been very effective. At the end of the day higher performance GPUs only serve to keep the cost of a cluster down vs u…

Post by [deleted] » Tue, Dec 31, 2024, 7:38 PM UTC

Bilal_io wrote: post #46

pmarreck wrote: post #38

Earlier quoted context omitted.

Yes, but there should be a difference between providing answers about provably dangerous things and providing provably false answers for political reasons. For example if there is a Russian LLM that refuses to answer any questions about homosexuality while also saying it's wrong, that's demonstrably false from an empirical basis. But the western LLM's are also doing this latter type of thing already. If you ask any o…

Western LLMs have a bias when it comes to Israel and Palestine issue. Out of curiously, what part of the Quran do you consider controversial?

Post by Onavo » Tue, Dec 31, 2024, 7:55 PM UTC

nsoonhui wrote: post #13

I find that the gushing around deepseek is fascinating to watch. To me there are a few structural and fundamental reasons why deepseek can never outperform other models by a wide margin. On par maybe--as we reach the diminishing returns with our investment in the models, but not win by a wide margin. 1. The US trade war with china which will place deepseek compute availability at disadvantages, eventually, if we ever…

Post by waldrews » Tue, Dec 31, 2024, 8:11 PM UTC

waldrews wrote: post #156

To this day, asking Deepseek "what model are you" typically gives the answer "I'm an AI language model called ChatGPT, created by OpenAI. Specifically, I'm based on the GPT-4 architecture, which is designed to understand and generate human-like text based on the input I receive. My training data includes a wide range of information up until October 2023, and I can assist with answering questions, generating text, and…

Post by amelius » Tue, Dec 31, 2024, 8:13 PM UTC

mentalgear wrote: post #3

Impressive to think about how DeepSeek achieved: ~ Parity with o1 and Claude with > 10x less resources. Better algorithms and approaches are what's needed for the next step of ML.