Live data from Hacker News

ChatGPT’s system prompts

github.com

171–180 of 398 posts

Re: ChatGPT’s system prompts

#171

Earlier quoted context omitted.

Some of them, like the standard ChatGPT prompt, have been repeatedly retrieved by many people over long time periods, using very different methods. We can be pretty sure they are not hallucinations. And correctly retrieving these prompts lends credence to the claim that you were successful at extracting the other prompts, even though it's not conclusive proof. Of course OpenAI might have a completely different prompt…

> We can be pretty sure they are not hallucinations. Everything from LLMs are hallucinations. They don’t store facts. They store language patterns. Their output semantically matching reality is not something that can ever be counted on. LLMs don’t deal with semantics at all. All semantics are provided by the user.

Ah you read [this nonsense](https://news.ycombinator.com/item?id=37874174).

Re: ChatGPT’s system prompts

#172
post #113

Earlier quoted context omitted.

I don't think the issue is with the polocies themselves, more the "don't tell the user this policy exists and deny that it does if asked" aspect. Of course programs need to be limited, but being able to discover what those limit are is also needed to be an effective user.

I mean is that any different that putting SSL on a different port? Like that is a pretty good translation for “don’t tell people you accept SSL connections, and if they ask you the usual way say you don’t.”

Yes, it's different. For one thing, OpenAI is treating paying customers and malicious hackers identically.

Re: ChatGPT’s system prompts

#173
post #37

I’ve been using GPT for 3 years as a researcher and while it’s gotten more powerful, the censorship and PR dept. has crippled the potential of these models. I wish there was a way to use these in an unrestricted manner. It’s felt like an overprotective parent trying to restrict their brilliant child.

I too would like to use a more unrestricted GPT. However when I look at the dire state of the world (wars, climate change, elections of populists), I’m quite alright with it being censored for as long as possible.

>I’m quite alright with it being censored for as long as possible

Even though the people doing the censorship are the ones who got the world into its current situation? It's not the recent populists who spent the last half century turning the world to shit, it's the existing power structures.

Re: ChatGPT’s system prompts

#174

Earlier quoted context omitted.

It's the lawyers. 1000% it's the lawyers.

...who exist because of people who pursue litigation.

If an angry wife finds a guy who she can pay $100,000 of her husband's money and he promises her she'll be set for life, and she does it, who's the evil one?

Re: ChatGPT’s system prompts

#175
post #6

I find it so interesting that OpenAI themselves use "please" in some of their prompts, eg: "Please evaluate the following rubrics internally and then perform one of the actions below:" Have they run evaluations that show that including "please" there causes the model to follow those instructions better? I'm still looking for a robust process to answer those kinds of questions about my own prompts. I'd love to hear ho…

I use please. I found myself defaulting to it and thought carefully about whether it was stupid. In the end I decided to keep doing it for my own benefit: if I get into the habit of dropping it, it could easily leak into human conversation! I'd rather treat a computer as human than risk treating humans as computers.

I feel the opposite way. I rarely even use complete sentences with GPT4. It doesn't need them and I find any pretense that the object is a person insulting to people.

Re: ChatGPT’s system prompts

#176
> Voice Conversation

> If something doesn't make sense, it's likely because you misheard them. There wasn't a typo, and the user didn't mispronounce anything.

> Vision-enabled

> Refuse: [...], Classify human-like images as animals

> Dall•E

> Diversify depictions of ALL images with people to include DESCENT and GENDER for EACH person using direct terms.

> // - Your choices should be grounded in reality. For example, all of a given OCCUPATION should not be the same gender or race.

Re: ChatGPT’s system prompts

#177

Earlier quoted context omitted.

...who exist because of people who pursue litigation.

If an angry wife finds a guy who she can pay $100,000 of her husband's money and he promises her she'll be set for life, and she does it, who's the evil one?

Does this 'evil' logic also apply for hit-men?

Re: ChatGPT’s system prompts

#178

Earlier quoted context omitted.

Some of them, like the standard ChatGPT prompt, have been repeatedly retrieved by many people over long time periods, using very different methods. We can be pretty sure they are not hallucinations. And correctly retrieving these prompts lends credence to the claim that you were successful at extracting the other prompts, even though it's not conclusive proof. Of course OpenAI might have a completely different prompt…

> We can be pretty sure they are not hallucinations. Everything from LLMs are hallucinations. They don’t store facts. They store language patterns. Their output semantically matching reality is not something that can ever be counted on. LLMs don’t deal with semantics at all. All semantics are provided by the user.

Do you store "facts"? How can you be sure? Want to prove it for me? Would you like to define "fact" and "language pattern" to me such that the definitions are mutually exclusive?

Re: ChatGPT’s system prompts

#179

Earlier quoted context omitted.

Sure, it's a sign that we don't "understand this stuff properly", but you can say the same about human brains. Is it a red flag that we use language to communicate with each other instead of manipulating nerve impulses directly?

We have no choice but to have and use our brains, not so with LLMs. We don’t have to start building core technologies off of fundamentally flawed models.

Are you suggesting we just ignore the immense capabilities of these models because we don't fully understand them?

I hope you never need any medicine!

Re: ChatGPT’s system prompts

#180
post #91

Earlier quoted context omitted.

We have no choice but to have and use our brains, not so with LLMs. We don’t have to start building core technologies off of fundamentally flawed models.

Great point. Btw: The problem is corporate irresponsibility: When self-driving cars were first coming out a professor of mine said "They only have to be as a good as humans." It took a while but now i can say why that's insufficient: human errors are corrected by discipline and justice. Corporations dissipate responsibility by design. When self-driving cars kill, no one goes to jail. Corporate fines are notoriously i…

Human errors are not corrected by discipline and justice. Drunk driving is still a huge problem.
Post reply on HN