NIST's DeepSeek "evaluation" is a hit piece
erichartford.com
NIST's DeepSeek "evaluation" is a hit piece
1–10 of 251 posts
Re: NIST's DeepSeek "evaluation" is a hit piece
#2I'm not at all surprised, US agencies have long since been political tools whenever the subject matter crosses national borders. I appreciate this take as someone who has been skeptical of Chinese electronics. While I agree this report is BS and xenophobic, I am still willing to bet that either now or later, the Chinese will attempt some kind of subterfuge via LLMs if they have enough control. Just like the US would, or any sufficiently powerful nation! It's important to continuously question models and continue benchmarking + holding them accountable to our needs, not the needs of those creating them.
Re: NIST's DeepSeek "evaluation" is a hit piece
#3I love how "Open" got redefined in the last few years. I am glad there a models with weights available but it ain't "Open Science".
Re: NIST's DeepSeek "evaluation" is a hit piece
#4I love how "Open" got redefined in the last few years. I am glad there a models with weights available but it ain't "Open Science".
Compared to every other model of similar scale and capability, yes. Not actual open source.
Re: NIST's DeepSeek "evaluation" is a hit piece
#5Let them demonize it. I'll use the capable and cheap model and gain competitive advantage.
Re: NIST's DeepSeek "evaluation" is a hit piece
#6I agree with many of the author's points about fear-mongering.
However, I also think the author should expand their definition of what constitutes "security" in the context of agentic AI.
Re: NIST's DeepSeek "evaluation" is a hit piece
#7> They didn't test U.S. models for U.S. bias. Only Chinese bias counts as a security risk, apparently
US models have no bias sir /s
Re: NIST's DeepSeek "evaluation" is a hit piece
#8[flagged]
Re: NIST's DeepSeek "evaluation" is a hit piece
#9[deleted]
Re: NIST's DeepSeek "evaluation" is a hit piece
#10I'm not at all surprised, US agencies have long since been political tools whenever the subject matter crosses national borders. I appreciate this take as someone who has been skeptical of Chinese electronics. While I agree this report is BS and xenophobic, I am still willing to bet that either now or later, the Chinese will attempt some kind of subterfuge via LLMs if they have enough control. Just like the US would,…
> I am still willing to bet that either now or later, the Chinese will attempt some kind of subterfuge via LLMs if they have enough control.
Like what, exactly?