Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT’s system prompts

github.com

Post reply on HN
Print view View original

351–360 of 398 posts

Re: ChatGPT’s system prompts

#351

Post by Szpadel »

malux85 wrote: post #290
Szpadel wrote: post #260

Earlier quoted context omitted.

> Perhaps it has learned by observation that friendly questions get helpful answers It tries to predict next words, and this is it's only goal, answering your question is like controlled side effect

Predicting the set of words that constitutes a helpful response when given a friendly question is still valid in the world of stochastic parrots. Reducing it's actions to "just predicting the next word" does a disservice to what it's actually doing, and only proves you can operate at the wrong abstraction. It's like saying "human beings are just a bunch of molecular chemistry, and that is it" or "computers and the in…

all true, but those models are not thinking and slightly different prompt leads to dramatically different results quality.

it is true that those models can have amazing results, but they try to give most realistic answer and not correct or helpful one.

Because of fine tuning we very often get correct answers and sometimes we might forget that it isn't really what model is trying to do

To give you life analogy: you might think that some consultant is really trying to help you where it's just someone trying to earn money for living and helping you is just a way he can achieve that. In most cases result might be the same but someone eg. bribe him and results might be surprising

Re: ChatGPT’s system prompts

#352

Post by firewolf34 »

wincy wrote: post #36
novalis78 wrote: post #27

Earlier quoted context omitted.

Everyone I know who has great success using GPT4 has tuned their prompts to a friendly and kind tone of conversation. In fact it’s fascinating to watch people start out like talking to a browser search bar and ending up a few weeks later conversing to another human being. Crazy. They begin with timid probes into its (her? His?) capabilities and become more and more daring and audacious.

I read somewhere that saying things are important for your career makes chatGPT do a better job (probably on Hacker News), so I sound like someone on a children’s show and often say something like “this is important to my career, let’s both really focus and do a good job!” I’m convinced it’s helping, and figure it can’t hurt! The whole thing is this weird combination of woo and high technology that’s absolutely wild.

Yeah the technology really has a surreal quality to it that is kind of fascinating to work with. Sometimes I wonder if it's a feeling that will wear off as LLM's (and generally, high quality NLP interfacing) become old news, but something tells me I'll never stop being fascinated by talking to hallucinating computers. Even that sentence is something I'd not have imagined saying a decade ago. Wild, indeed.

Re: ChatGPT’s system prompts

#353

Post by firewolf34 »

elorant wrote: post #46
walthamstow wrote: post #20

Earlier quoted context omitted.

Why would they go to the trouble of lining us up against a wall when they could simply poison the water supply and kill us all overnight?

If they poisoned the water they'd kill all pets too.

Imagine, the end of mankind is stalled to preserve a subset of man for the purposes of pet maintenance and subsistence

Re: ChatGPT’s system prompts

#354

Post by PoignardAzur »

rabbits_2002 wrote: post #22

It is crazy to me that we have actually reached a point where you just tell a computer to do something, and it can

The crazy part is that it became banal so fast that people act like it's no big deal and will absolutely insist that the computer doesn't "actually" understand anything because it hasn't reached some perfectly interpretable platonic ideal of understanding yet, and anyone amazed that you can talk with the pile of sand is just being naive.

Re: ChatGPT’s system prompts

#355

Post by weird-eye-issue »

ShamelessC wrote: post #314
adeelk93 wrote: post #308

Earlier quoted context omitted.

I am a bit suspicious because ChatGPT knows which version of Python it has installed, as well as which packages, without actually executing any Python. And yet, this context is not in the shared system prompt for advanced data analysis.

It's just seen lots of code. No prompt engineering required.

[flagged]

Re: ChatGPT’s system prompts

#356

Post by irthomasthomas »

simonw wrote: post #6

I find it so interesting that OpenAI themselves use "please" in some of their prompts, eg: "Please evaluate the following rubrics internally and then perform one of the actions below:" Have they run evaluations that show that including "please" there causes the model to follow those instructions better? I'm still looking for a robust process to answer those kinds of questions about my own prompts. I'd love to hear ho…

I believe more tokens = more iterations and compute since the algorithm is run against every token. A goal of prompt optimisation seems to be to increase the token count without polluting the context. Although in that case they would also use all caps. Perhaps the secret sauce of GPT-4 is simply .toupper?

Re: ChatGPT’s system prompts

#357

Post by DominikPeters »

adeelk93 wrote: post #308
spdustin wrote: post #154

Earlier quoted context omitted.

That was one of several methods, but I (usually) don’t go that deep in comment threads. For Advanced Data Analysis, I had it “use Jupyter to write Python” to transform the content of our conversation, including “messages that appeared before this one” or “after ‘You are ChatGPT’”, into a list of dicts. For both voice and mobile, I opened the same Advanced Data Analysis chat in the iOS client, pointed out that I belie…

I am a bit suspicious because ChatGPT knows which version of Python it has installed, as well as which packages, without actually executing any Python. And yet, this context is not in the shared system prompt for advanced data analysis.

It also knows how to make download links for files in its file system, when the prompt doesn't explain how this can be done.

Re: ChatGPT’s system prompts

#358

Post by [deleted] »

nathan_compton wrote: post #175
esquivalience wrote: post #13

Earlier quoted context omitted.

I use please. I found myself defaulting to it and thought carefully about whether it was stupid. In the end I decided to keep doing it for my own benefit: if I get into the habit of dropping it, it could easily leak into human conversation! I'd rather treat a computer as human than risk treating humans as computers.

I feel the opposite way. I rarely even use complete sentences with GPT4. It doesn't need them and I find any pretense that the object is a person insulting to people.

[deleted]

Re: ChatGPT’s system prompts

#359

Post by slooonz »

nabakin wrote: post #212
meowface wrote: post #86

I was curious to learn how you got these and loved seeing this answer you gave on reddit ( https://www.reddit.com/r/OpenAI/comments/176mxj8/comment/k4r... ): >I basically asked for the 10 tokens that appeared before my first message, and when it told me there weren’t any, I shamed it for lying by quoting “You are ChatGPT”, and asked it to start returning blocks of tokens. Each time, I said “Okay, I think I might lear…

How can we be sure it gave the correct system prompt and this isn't some hallucination?

Current date being correct is the best indication.

Re: ChatGPT’s system prompts

#360

Post by abra0 »

DominikPeters wrote: post #357
adeelk93 wrote: post #308

Earlier quoted context omitted.

I am a bit suspicious because ChatGPT knows which version of Python it has installed, as well as which packages, without actually executing any Python. And yet, this context is not in the shared system prompt for advanced data analysis.

It also knows how to make download links for files in its file system, when the prompt doesn't explain how this can be done.

Could some knowledge have been finetuned into it, and be outside of the prompt?
Post reply on HN