Earlier quoted context omitted.
Sure, in part by "stealing" from American AI companies with Distillation attacks: https://yipzap.com/anthropic-accuses-alibaba-of-largest-ai-d...
If your moat is “please don’t copy my outputs”, you don’t have a moat. There is no such thing as a distillation “attack”.
DSpark: Speculative decoding accelerates LLM inference [pdf]
121–130 of 393 posts
Re: DSpark: Speculative decoding accelerates LLM inference [pdf]
#122Re: DSpark: Speculative decoding accelerates LLM inference [pdf]
#123Earlier quoted context omitted.
This is incorrect binary thinking. Them releasing open source can be good, but that does not commit you to think that china or chinese companies are saints. There are many shades of grey here and one does not exclude the other (nor include it).
Are you reading the comments?
Re: DSpark: Speculative decoding accelerates LLM inference [pdf]
#124Earlier quoted context omitted.
Probably because American AI companies are on the hook for quite a lot of investment money. I think they are trying to find the magical moat to justify their valuation. Revealing optimizations similar to these would pretty much reduce their competitive position.
Who is financing DeepSeek and what are they expecting in return?
???
Profit!
Not suggesting this is it, but you know, one possible angle.
Re: DSpark: Speculative decoding accelerates LLM inference [pdf]
#125Earlier quoted context omitted.
> Chinese labs are also still behind, so they’re incentivized to collaborate and have no reason to do it in private. US labs in Google, Meta and SpaceX are not leading, none of them managed to build something on par with GLM 5.2. Care to explain to me why they still don't collaborate and still choose to do it in private?
Google at least still releases open source models to the public.
Re: DSpark: Speculative decoding accelerates LLM inference [pdf]
#126Earlier quoted context omitted.
Probably because American AI companies are on the hook for quite a lot of investment money. I think they are trying to find the magical moat to justify their valuation. Revealing optimizations similar to these would pretty much reduce their competitive position.
Chinese labs are also still behind, so they’re incentivized to collaborate and have no reason to do it in private. I suspect their tune will change if they ever take the lead..
Re: DSpark: Speculative decoding accelerates LLM inference [pdf]
#127DeepSeek continues to not only push the boundaries but also publish these incredible papers explaining how they achieved their gains - something the American labs no longer do unfortunately. Chinese labs are doing the most interesting work in AI right now.
Re: DSpark: Speculative decoding accelerates LLM inference [pdf]
#128I am wondering if this is why they can offer their pro model at ~1/4th of the price compared to the other providers offering the same model, and if other providers will be able to do the same in a short timeframe.
Re: DSpark: Speculative decoding accelerates LLM inference [pdf]
#129These companies providing tokens, whether SOTA or not, that want to IPO are so fucked as time goes on. Can't sell their SOTA models, only slightly better than the open source models for the models they can sell, cost 20x to 50x for good models, a TAM that consists almost solely of developers, with no customer of theirs actually boasting increased profits as a result of AI... I fear their time to IPO may have passed.
The question is even, was there EVER a time for an IPO? If the business model requires hundreds of billions to get the required quality (R&D but also infrastructure to collect data and train, either purchased or rented to 3rd party) while "only" dozens of billions can be earned back (as costs still exist to earn, it's not free once models are trained), then maybe there NEVER was nor till be a good time for an IPO in…
Re: DSpark: Speculative decoding accelerates LLM inference [pdf]
#130Earlier quoted context omitted.
So the marketplace is working.
This is the way! Open source models will benefit, and once open source models reach the state of "good enough" the hyped up US AI companies will fear, since the availability of free, good enough, AI models will set the ceiling for how much they can charge. Then the bubble will pop.