I do think that distilling a model from another is much less impressive than distilling one from raw text. However, it is hard to say if it is really illegal or even immoral, perhaps just one step further in the evolution of the space.
OpenAI says it has evidence DeepSeek used its model to train competitor
41–50 of 1001 posts
Re: OpenAI says it has evidence DeepSeek used its model to train competitor
#42Earlier quoted context omitted.
Would it even matter? Isn't the cat out of the bag and everything they did repeatable by an American research team?
It matters because their goal was hyping up how advanced and difficult their tech is, propping up their valuations. DeepSeek proved the emperor had no clothes and wiped out a lot of their valuation when investors saw reaching parity to Chtgpt is not really that difficult.
Re: OpenAI says it has evidence DeepSeek used its model to train competitor
#43Re: OpenAI says it has evidence DeepSeek used its model to train competitor
#44Re: OpenAI says it has evidence DeepSeek used its model to train competitor
#45Re: OpenAI says it has evidence DeepSeek used its model to train competitor
#46Re: OpenAI says it has evidence DeepSeek used its model to train competitor
#47Re: OpenAI says it has evidence DeepSeek used its model to train competitor
#48This is absolutely hilarious! :) ClosedAI scraped human content without asking and they explained why this was acceptable... but when the outputs of their training corpus is scraped, it is THEIR dataset and this is NOT acceptable! Oh, the irony! :D I shared a few screenshots of DeepSeek answering using ChatGPT's output in yesterday's article! https://semking.com/deepseek-china-ai-model-breakthrough-sec...
Also, DeepSeek is allegedly... better? So saying they just copied ClosedAI isn't really sufficient of an answer. Seems to be just bluster because the US Govt would probably accept any excuse to ban it, see TikTok.
Read the two following sections of my blog post:
1. "Distilled language models"
2. "DeepSeek: Less supervision"