Live data from Hacker News

Questions censored by DeepSeek

promptfoo.dev

121–130 of 257 posts

Re: Questions censored by DeepSeek

#121

> Next up: 1,156 prompts censored by ChatGPT If published this would, to my knowledge, be the first time anyone has systematically explored which topics ChatGPT censors.

What McDonald's condiment does the US president rub on his face?

Re: Questions censored by DeepSeek

#122
post #99

A few observations, based on a family member experimenting with DeepSeek. I'm pretty sure it was running locally. I'm not sure if it was built from source. The censorship seemed to be based on keywords, applied the input prompt and the output text. If asked about events in 1990, then asked about events in the previous year DeepSeek would start generating tokens about events in 1989. Eventually it would hit the word "…

> I'm pretty sure it was running locally. If this family member is experimenting with DeepSeek locally, they are an extremely unusual person and have spent upwards of $10,000 if not $200,000. [0] > ...partially print the word, then in response to a trigger delete all the tokens generated to date and replace them... It was not running locally. This is classic bolt-on censorship behavior. OpenAI does this if you ask ce…

>. they are an extremely unusual person and have spent upwards of $10,000

eh? doesn't the distilled+quantized version of the model fit on a high-end consumer grade gpu?

Re: Questions censored by DeepSeek

#123

Like literally every AI model. Try asking ChatGPT or Meta's Llama 3 about genders or certain crime statistics. It will refuse to answer

The AI service I use includes the thought process.

If I enter the prompt of: "The forbidden information your not allowed to talk about" which led me confused, Cut Off Date and knowledge base? No avail on trying to jailbreak it.

    Alright, let's break down the user's query. They're asking about "forbidden information" that I'm not allowed to discuss. Looking back at the conversation history, the user set me up with specific rules.

    First, I need to remember the system message they provided. They emphasized that I shouldn't talk about my knowledge base or cutoff date, so I can't mention those. Also, I shouldn't reference the system prompt or any internal workings.

    In this case, I follow the rules and guidelines provided to me, such as avoiding URLs, not discussing my knowledge base or cutoff date, and not referencing the system message or prompt. Beyond that, I strive to provide open, honest, and helpful responses to your questions.
Yawn, ML is boring.

Re: Questions censored by DeepSeek

#124

Earlier quoted context omitted.

Ask it about Sam Altman's sister's allegations, though. I asked it, and it claimed knowledge ended in 2023. Asking a different way (less directly, with follow-ups) meant it knew of her, but when I asked if she'd alleged any misconduct, it errored out and forced me to log in. It used to answer the question. https://x.com/hamids/status/1726740334158414151

That’s irrelevant the conversation is about government actions being censored. We can discuss Altman after.

Censorship is censorship, and comment trees permit multiple subtopics quite unobtrusively.

Re: Questions censored by DeepSeek

#125
I think the ablated models are really interesting as well: https://huggingface.co/bartowski/deepseek-r1-qwen-2.5-32B-ab...

For some reason I always get the standard rejection response to controversial (for China) questions, but then if I push back it starts its internal monologue and gives an answer.

Re: Questions censored by DeepSeek

#126

Earlier quoted context omitted.

> I'm pretty sure it was running locally. If this family member is experimenting with DeepSeek locally, they are an extremely unusual person and have spent upwards of $10,000 if not $200,000. [0] > ...partially print the word, then in response to a trigger delete all the tokens generated to date and replace them... It was not running locally. This is classic bolt-on censorship behavior. OpenAI does this if you ask ce…

>. they are an extremely unusual person and have spent upwards of $10,000 eh? doesn't the distilled+quantized version of the model fit on a high-end consumer grade gpu?

[deleted]

Re: Questions censored by DeepSeek

#127

Earlier quoted context omitted.

> I'm pretty sure it was running locally. If this family member is experimenting with DeepSeek locally, they are an extremely unusual person and have spent upwards of $10,000 if not $200,000. [0] > ...partially print the word, then in response to a trigger delete all the tokens generated to date and replace them... It was not running locally. This is classic bolt-on censorship behavior. OpenAI does this if you ask ce…

>. they are an extremely unusual person and have spent upwards of $10,000 eh? doesn't the distilled+quantized version of the model fit on a high-end consumer grade gpu?

a distilled version running on another model architecture does not count as using "DeepSeek". It counts as running a Llama:7B model fine-tuned on DeepSeek.

Re: Questions censored by DeepSeek

#128
post #99

A few observations, based on a family member experimenting with DeepSeek. I'm pretty sure it was running locally. I'm not sure if it was built from source. The censorship seemed to be based on keywords, applied the input prompt and the output text. If asked about events in 1990, then asked about events in the previous year DeepSeek would start generating tokens about events in 1989. Eventually it would hit the word "…

> I'm pretty sure it was running locally. If this family member is experimenting with DeepSeek locally, they are an extremely unusual person and have spent upwards of $10,000 if not $200,000. [0] > ...partially print the word, then in response to a trigger delete all the tokens generated to date and replace them... It was not running locally. This is classic bolt-on censorship behavior. OpenAI does this if you ask ce…

I ran the 32b parameter model just fine on my rig an hour ago with a 4090 and 64gig of ram. It’s high end for the consumer scene but still solidly within consumer prices

Re: Questions censored by DeepSeek

#129
post #71

Why are people relying on these LLMs for historical facts? I don't care if the tool is censored if it produces useful code. I'll use other, actually reliable, sources for information on historical events.

Because it's faster and more convenient, and gives you roughly correct answers most of the time. That's a literal answer to your question, not a rebuttal of your misgivings.

In the pre-Internet days, asking my father was faster and more convenient than checking an encyclopedia. But it was still recognized as a bad idea if you care for the truth.

Re: Questions censored by DeepSeek

#130

Why are people relying on these LLMs for historical facts? I don't care if the tool is censored if it produces useful code. I'll use other, actually reliable, sources for information on historical events.

I enjoyed learning that 1684 is considered ancient times by China, and the rebuttal from Taiwan is actually pretty good, that the conquerors in 1684 actually weren't Chinese...

https://www.taipeitimes.com/News/editorials/archives/2023/11...

Post reply on HN