181–190 of 393 posts
Would love to see these numbers reproduced on consumer GPUs, not just A100s.
It should improve performance on most hardware because most LLMs are memory bandwidth bound during decode.
This paper seems to be an improvement to speculative decoding but I haven't read it yet.
Nice. Guessing the timing isn't accidental. Demonstrated openness vs harsh regulation
China = Open. US = Harsh Regulation Strange timeline, though this only works because it’s aligned with Xi’s goals.
Mistral...don't fumble this
DeepSeek continues to not only push the boundaries but also publish these incredible papers explaining how they achieved their gains - something the American labs no longer do unfortunately. Chinese labs are doing the most interesting work in AI right now.
We in the United States will never forget!
For all the harm Trump does to the US at least he is helping China!
Earlier quoted context omitted.
Chinese labs are also still behind, so they’re incentivized to collaborate and have no reason to do it in private. I suspect their tune will change if they ever take the lead..
Which is a good thing. Self-serving motives are more reliable than altruistic ones.
Earlier quoted context omitted.
They are self financed, the company that makes DeepSeek is a finance company that trades on the markets.
The CCP's approach has historically been to subsidize their companies far more than other countries do. Why would LLMs be any different? https://www.oecd.org/en/data/dashboards/magic-database-indus...
DeepSeek is, as I feel currently, the sole AI company which is actually trying to innovate rather than top mere benchmarks. Others like OpenAI, Anthropic and Google are mostly just competeing with each rather than keep innovating around the clock.
To compete in that direction, USG needs to learn from CCP to "seize the means of production", which they are sort of doing, but in such an incompetent way that I'm afraid we will probably end up mixing the worst of both communism and capitalism.
Earlier quoted context omitted.
Probably because American AI companies are on the hook for quite a lot of investment money. I think they are trying to find the magical moat to justify their valuation. Revealing optimizations similar to these would pretty much reduce their competitive position.
Chinese labs are also still behind, so they’re incentivized to collaborate and have no reason to do it in private. I suspect their tune will change if they ever take the lead..
Earlier quoted context omitted.
Not everyone is motivated by greed
What do you think is the underlaying motivation?