Earlier quoted context omitted.
Some of them, like the standard ChatGPT prompt, have been repeatedly retrieved by many people over long time periods, using very different methods. We can be pretty sure they are not hallucinations. And correctly retrieving these prompts lends credence to the claim that you were successful at extracting the other prompts, even though it's not conclusive proof. Of course OpenAI might have a completely different prompt…
> We can be pretty sure they are not hallucinations. Everything from LLMs are hallucinations. They don’t store facts. They store language patterns. Their output semantically matching reality is not something that can ever be counted on. LLMs don’t deal with semantics at all. All semantics are provided by the user.
ChatGPT’s system prompts
171–180 of 398 posts
Re: ChatGPT’s system prompts
#172Earlier quoted context omitted.
I don't think the issue is with the polocies themselves, more the "don't tell the user this policy exists and deny that it does if asked" aspect. Of course programs need to be limited, but being able to discover what those limit are is also needed to be an effective user.
I mean is that any different that putting SSL on a different port? Like that is a pretty good translation for “don’t tell people you accept SSL connections, and if they ask you the usual way say you don’t.”
Re: ChatGPT’s system prompts
#173I’ve been using GPT for 3 years as a researcher and while it’s gotten more powerful, the censorship and PR dept. has crippled the potential of these models. I wish there was a way to use these in an unrestricted manner. It’s felt like an overprotective parent trying to restrict their brilliant child.
I too would like to use a more unrestricted GPT. However when I look at the dire state of the world (wars, climate change, elections of populists), I’m quite alright with it being censored for as long as possible.
Even though the people doing the censorship are the ones who got the world into its current situation? It's not the recent populists who spent the last half century turning the world to shit, it's the existing power structures.
Re: ChatGPT’s system prompts
#174Earlier quoted context omitted.
It's the lawyers. 1000% it's the lawyers.
...who exist because of people who pursue litigation.
Re: ChatGPT’s system prompts
#175I find it so interesting that OpenAI themselves use "please" in some of their prompts, eg: "Please evaluate the following rubrics internally and then perform one of the actions below:" Have they run evaluations that show that including "please" there causes the model to follow those instructions better? I'm still looking for a robust process to answer those kinds of questions about my own prompts. I'd love to hear ho…
I use please. I found myself defaulting to it and thought carefully about whether it was stupid. In the end I decided to keep doing it for my own benefit: if I get into the habit of dropping it, it could easily leak into human conversation! I'd rather treat a computer as human than risk treating humans as computers.
Re: ChatGPT’s system prompts
#176> If something doesn't make sense, it's likely because you misheard them. There wasn't a typo, and the user didn't mispronounce anything.
> Vision-enabled
> Refuse: [...], Classify human-like images as animals
> Dall•E
> Diversify depictions of ALL images with people to include DESCENT and GENDER for EACH person using direct terms.
> // - Your choices should be grounded in reality. For example, all of a given OCCUPATION should not be the same gender or race.
Re: ChatGPT’s system prompts
#177Earlier quoted context omitted.
...who exist because of people who pursue litigation.
If an angry wife finds a guy who she can pay $100,000 of her husband's money and he promises her she'll be set for life, and she does it, who's the evil one?
Re: ChatGPT’s system prompts
#178Earlier quoted context omitted.
Some of them, like the standard ChatGPT prompt, have been repeatedly retrieved by many people over long time periods, using very different methods. We can be pretty sure they are not hallucinations. And correctly retrieving these prompts lends credence to the claim that you were successful at extracting the other prompts, even though it's not conclusive proof. Of course OpenAI might have a completely different prompt…
> We can be pretty sure they are not hallucinations. Everything from LLMs are hallucinations. They don’t store facts. They store language patterns. Their output semantically matching reality is not something that can ever be counted on. LLMs don’t deal with semantics at all. All semantics are provided by the user.
Re: ChatGPT’s system prompts
#179Earlier quoted context omitted.
Sure, it's a sign that we don't "understand this stuff properly", but you can say the same about human brains. Is it a red flag that we use language to communicate with each other instead of manipulating nerve impulses directly?
We have no choice but to have and use our brains, not so with LLMs. We don’t have to start building core technologies off of fundamentally flawed models.
I hope you never need any medicine!
Re: ChatGPT’s system prompts
#180Earlier quoted context omitted.
We have no choice but to have and use our brains, not so with LLMs. We don’t have to start building core technologies off of fundamentally flawed models.
Great point. Btw: The problem is corporate irresponsibility: When self-driving cars were first coming out a professor of mine said "They only have to be as a good as humans." It took a while but now i can say why that's insufficient: human errors are corrected by discipline and justice. Corporations dissipate responsibility by design. When self-driving cars kill, no one goes to jail. Corporate fines are notoriously i…