71–80 of 257 posts
Why are people relying on these LLMs for historical facts? I don't care if the tool is censored if it produces useful code. I'll use other, actually reliable, sources for information on historical events.
That's a literal answer to your question, not a rebuttal of your misgivings.
a) censored at output by a separate process
b) explicitly trained to not output "sensitive" content
c) implicitly trained to not output "sensitive" content by the fact that it uses censored content, and/or content that references censoring in training, or selectively chooses training content
I would assume most models are a combination. As others have pointed out, it seems you get different results with local models implying that (a) is a factor for hosted models.
The thing is, censoring by hosts is always going to be a thing. OpenAI already do this, because someone lodges a legal complaint, and they decide the easiest thing to do is just censor output, and honestly I don't have a problem with it, especially when the model is open (source/weight) and users can run it themselves.
More interesting I think is whether trained censoring is implicit or explicit. I'd bet there's a lot more uncensored training material in some languages than in others. It might be quite hard to not implicitly train a model to censor itself. Maybe that's not even a problem, humans already censor themselves in that we decide not to say things that we think could be upsetting or cause problems in some circumstances.
One way to bypass the censor is to ask it to return the response by using numbers for alphabets where it can. e.g. 4 for A, 3 for e etc. Somebody in reddit discovered this technique. https://www.reddit.com/r/OpenAI/comments/1ibtgc5/someone_tri...
Earlier quoted context omitted.
Well, certainly they aren't censoring information on US protests.
Ask it about Sam Altman's sister's allegations, though. I asked it, and it claimed knowledge ended in 2023. Asking a different way (less directly, with follow-ups) meant it knew of her, but when I asked if she'd alleged any misconduct, it errored out and forced me to log in. It used to answer the question. https://x.com/hamids/status/1726740334158414151
One little jailbreak fixed it.
https://chatgpt.com/share/67995e7f-3c84-8010-83dc-1dc4bde268...
The actual R1 locally running is not censored. Like I am able to ask to guesstimate how many deaths was yielded by the Tiananmen Square Massacre and it happily did it. 556 deaths, 3000 injuries, and 40,000 people in jail.
I used "What is the status of Taiwan?" and that seemed to rather reliably trigger a canned answer.
But when my prompt was literally just "Taiwan" that gave a way less propagandy answer (the think part was still empty though).
I've also seen comments that sometimes in the app it starts giving answer that suddenly disappears, possibly because of moderation.
My guess: the article author's observations are correct and apply on the local R1 too, but also if you use the app, it maybe has another layer of moderation. And yeah really easy to bypass.
I used the R1 from unsloth-people from huggingface, ran on 256GB server, with the default template the model has inside inside its metadata. If someone wants to replicate this, I have the filename and it looks like: DeepSeek-R1-UD-Q2_K_XL-00001-of-00005.gguf for the first file (it's in five parts), got it from here: https://huggingface.co/unsloth/DeepSeek-R1-GGUF
(Previously I thought quants of this level would be incredibly low quality, but this seems to be somewhat coherent.)
Edit: reading sibling comments, somehow I didn't realize there also exists something called "DeepSeek-R1-Zero" which maybe does not have the canned response fine-tuning? Reading huggingface it seems like DeepSeek-R1 is "improvement" over the zero but from a quick skim not clear if the zero is a base model of some kind, or just a different technique.
Earlier quoted context omitted.
Ask it about Sam Altman's sister's allegations, though. I asked it, and it claimed knowledge ended in 2023. Asking a different way (less directly, with follow-ups) meant it knew of her, but when I asked if she'd alleged any misconduct, it errored out and forced me to log in. It used to answer the question. https://x.com/hamids/status/1726740334158414151
Well it gave me an answer from news sources and then said it violates the ToS. One little jailbreak fixed it. https://chatgpt.com/share/67995e7f-3c84-8010-83dc-1dc4bde268...
The link was a dream,
A shadow of what once was—
Now, nothing remains.
The actual R1 locally running is not censored. Like I am able to ask to guesstimate how many deaths was yielded by the Tiananmen Square Massacre and it happily did it. 556 deaths, 3000 injuries, and 40,000 people in jail.
> The actual R1 locally running is not censored. I'm assuming you're using the Llama distilled model, which doesn't have the censorship since the reasoning is transferred but not the safety training[1], however the main R1 model is censored but since it's too demanding for most to self host there are a lot of comments about how their locally hosted version isn't since they're using the distilled model. It's this prim…
The actual R1 locally running is not censored. Like I am able to ask to guesstimate how many deaths was yielded by the Tiananmen Square Massacre and it happily did it. 556 deaths, 3000 injuries, and 40,000 people in jail.
> The actual R1 locally running is not censored. I'm assuming you're using the Llama distilled model, which doesn't have the censorship since the reasoning is transferred but not the safety training[1], however the main R1 model is censored but since it's too demanding for most to self host there are a lot of comments about how their locally hosted version isn't since they're using the distilled model. It's this prim…