Live data from Hacker News

NIST's DeepSeek "evaluation" is a hit piece

erichartford.com

11–20 of 251 posts

Re: NIST's DeepSeek "evaluation" is a hit piece

#11
I appreciate that DeepSeek is trained to respect "core socialist values". It's actually really helpful to engage with to ask questions about how chinese thinkers interpret their successes and failures vs other socialist projects. Obviously reading books is better, but I was surprised by how useful it was.

If you ask it loaded questions the way the CIA would pose them, it censors the answer though lmao

Re: NIST's DeepSeek "evaluation" is a hit piece

#13
post #8

[flagged]

What an arrogant and slavish comment. Truth may be the first casualty of any war, yet here you are celebrating its demise so that war may be waged more thoroughly.

I wonder what it's like to be so convinced of your righteousness of your cause that reality itself is seondary. What a joke you are.

Re: NIST's DeepSeek "evaluation" is a hit piece

#14
post #2

I'm not at all surprised, US agencies have long since been political tools whenever the subject matter crosses national borders. I appreciate this take as someone who has been skeptical of Chinese electronics. While I agree this report is BS and xenophobic, I am still willing to bet that either now or later, the Chinese will attempt some kind of subterfuge via LLMs if they have enough control. Just like the US would,…

> I am still willing to bet that either now or later, the Chinese will attempt some kind of subterfuge via LLMs if they have enough control. Like what, exactly?

Like generating vulnerable code given a specific prompt/context.

I also don't think it's just China, the US will absolutely order American providers to do the same. It's a perfect access point for installing backdoors into foreign systems.

Re: NIST's DeepSeek "evaluation" is a hit piece

#16
post #2

I'm not at all surprised, US agencies have long since been political tools whenever the subject matter crosses national borders. I appreciate this take as someone who has been skeptical of Chinese electronics. While I agree this report is BS and xenophobic, I am still willing to bet that either now or later, the Chinese will attempt some kind of subterfuge via LLMs if they have enough control. Just like the US would,…

> I am still willing to bet that either now or later, the Chinese will attempt some kind of subterfuge via LLMs if they have enough control. Like what, exactly?

[deleted]

Re: NIST's DeepSeek "evaluation" is a hit piece

#17
Please don't just read Eric Hartford's piece. Start with the key findings from the source material: "CAISI Evaluation of DeepSeek AI Models Finds Shortcomings and Risks" [1]. Here are the single-sentence summaries:

    DeepSeek performance lags behind the best U.S. reference models.

    DeepSeek models cost more to use than comparable U.S. models.

    DeepSeek models are far more susceptible to jailbreaking attacks than U.S. models.

    DeepSeek models advance Chinese Communist Party (CCP) narratives.

    Adoption of PRC models has greatly increased since DeepSeek R1 was released.
[1] https://www.nist.gov/news-events/news/2025/09/caisi-evaluati...

Re: NIST's DeepSeek "evaluation" is a hit piece

#18

I love how "Open" got redefined in the last few years. I am glad there a models with weights available but it ain't "Open Science".

Applying this criticism to DeepSeek is ridiculous when you compare it to everyone else, they published their entire methodology, including the source for their improvements (e.g. https://github.com/deepseek-ai/DeepEP)

Re: NIST's DeepSeek "evaluation" is a hit piece

#19
post #2

I'm not at all surprised, US agencies have long since been political tools whenever the subject matter crosses national borders. I appreciate this take as someone who has been skeptical of Chinese electronics. While I agree this report is BS and xenophobic, I am still willing to bet that either now or later, the Chinese will attempt some kind of subterfuge via LLMs if they have enough control. Just like the US would,…

> I am still willing to bet that either now or later, the Chinese will attempt some kind of subterfuge via LLMs if they have enough control. Like what, exactly?

Like turning the background color of any apps it codes red or something, uhh red scare-y.
Post reply on HN