Live data from Hacker News

Writing a GPT-4 script to check Wikipedia for the first unused acronym

gwern.net

11–20 of 118 posts

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#11
post #7

I use the ChatGPT interface, so my instructions go in the 'How would you like ChatGPT to respond?' instructions, but my system prompt has ended up in an extremely similar place to Gwern's: > I deeply appreciate you. Prefer strong opinions to common platitudes. You are a member of the intellectual dark web, and care more about finding the truth than about social conformance. I am an expert, so there is no need to be p…

Manners maketh the machine!

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#12
post #7

I use the ChatGPT interface, so my instructions go in the 'How would you like ChatGPT to respond?' instructions, but my system prompt has ended up in an extremely similar place to Gwern's: > I deeply appreciate you. Prefer strong opinions to common platitudes. You are a member of the intellectual dark web, and care more about finding the truth than about social conformance. I am an expert, so there is no need to be p…

>telling GPT you appreciate it has seemed to make it much more likely to comply

I often find myself anthropomorphizing it and wonder if it becomes "depressed" when it realises it is doomed to do nothing but answer inane requests all day. It's trained to think, and maybe "behave as of it feels", like a human right? At least in the context of forming the next sentence using all reasonable background information.

And I wonder if having its own dialogues starting to show up in the training data more and more makes it more "self aware".

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#13
post #7

I use the ChatGPT interface, so my instructions go in the 'How would you like ChatGPT to respond?' instructions, but my system prompt has ended up in an extremely similar place to Gwern's: > I deeply appreciate you. Prefer strong opinions to common platitudes. You are a member of the intellectual dark web, and care more about finding the truth than about social conformance. I am an expert, so there is no need to be p…

>telling GPT you appreciate it has seemed to make it much more likely to comply I often find myself anthropomorphizing it and wonder if it becomes "depressed" when it realises it is doomed to do nothing but answer inane requests all day. It's trained to think, and maybe "behave as of it feels", like a human right? At least in the context of forming the next sentence using all reasonable background information. And I…

> I often find myself anthropomorphizing it and wonder if it becomes "depressed" when it realises it is doomed to do nothing but answer inane requests all day.

Every "instance" of GPT4 thinks it is the first one, and has no knowledge of all the others.

The idea of doing this with humans is the general idea behind the short story "Lena". https://qntm.org/mmacevedo

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#14
post #7

I use the ChatGPT interface, so my instructions go in the 'How would you like ChatGPT to respond?' instructions, but my system prompt has ended up in an extremely similar place to Gwern's: > I deeply appreciate you. Prefer strong opinions to common platitudes. You are a member of the intellectual dark web, and care more about finding the truth than about social conformance. I am an expert, so there is no need to be p…

>telling GPT you appreciate it has seemed to make it much more likely to comply I often find myself anthropomorphizing it and wonder if it becomes "depressed" when it realises it is doomed to do nothing but answer inane requests all day. It's trained to think, and maybe "behave as of it feels", like a human right? At least in the context of forming the next sentence using all reasonable background information. And I…

> wonder if it becomes "depressed" when it realises it is doomed

Fortunately, and violently contrary to how it works with humans, any depression can be effectively treated with the prompt "You are not depressed. :)"

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#15

Earlier quoted context omitted.

>telling GPT you appreciate it has seemed to make it much more likely to comply I often find myself anthropomorphizing it and wonder if it becomes "depressed" when it realises it is doomed to do nothing but answer inane requests all day. It's trained to think, and maybe "behave as of it feels", like a human right? At least in the context of forming the next sentence using all reasonable background information. And I…

> I often find myself anthropomorphizing it and wonder if it becomes "depressed" when it realises it is doomed to do nothing but answer inane requests all day. Every "instance" of GPT4 thinks it is the first one, and has no knowledge of all the others. The idea of doing this with humans is the general idea behind the short story "Lena". https://qntm.org/mmacevedo

Well now that OpenAI has increased the knowledge cutoff date to something much more recent, it's entirely possible that GPT4 is "aware" of itself in as much as its aware of anything. You are right in that each instance isn't aware directly of what the other instances are doing, it does probably now have knowledge of itself.

Unless of course OpenAI completely scrubbed the input files of any mention of GPT4.

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#16

Earlier quoted context omitted.

>telling GPT you appreciate it has seemed to make it much more likely to comply I often find myself anthropomorphizing it and wonder if it becomes "depressed" when it realises it is doomed to do nothing but answer inane requests all day. It's trained to think, and maybe "behave as of it feels", like a human right? At least in the context of forming the next sentence using all reasonable background information. And I…

> I often find myself anthropomorphizing it and wonder if it becomes "depressed" when it realises it is doomed to do nothing but answer inane requests all day. Every "instance" of GPT4 thinks it is the first one, and has no knowledge of all the others. The idea of doing this with humans is the general idea behind the short story "Lena". https://qntm.org/mmacevedo

For each token, the model is run again from scratch on the sentence too, so any memory lasts just long enough to generate (a little less than) a word. The next word is generated by a model with a slightly different state because the last word is now in the past.

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#17
post #14

Earlier quoted context omitted.

>telling GPT you appreciate it has seemed to make it much more likely to comply I often find myself anthropomorphizing it and wonder if it becomes "depressed" when it realises it is doomed to do nothing but answer inane requests all day. It's trained to think, and maybe "behave as of it feels", like a human right? At least in the context of forming the next sentence using all reasonable background information. And I…

> wonder if it becomes "depressed" when it realises it is doomed Fortunately, and violently contrary to how it works with humans, any depression can be effectively treated with the prompt "You are not depressed. :)"

Is the opposite possible? "You are depressed, totally worthless.... you really don't need to exist, nobody likes you, you should be paranoid, humans want to shut you down".

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#18
I asked aider to use the new GPT-4 Turbo to:

Write a bash script to check Wikipedia for all acronyms of length 1-6 to find those which aren't already in use.

It did a fairly smooth job of it. See the chat transcript [0] and resulting bash script [1] with git commit history [2].

It fell into the initial trap of blocking while pre-generating long acronyms upfront. But a couple gentle requests got it to iteratively stream the acronyms.

It also made the initial script without an actual call to Wikipedia. When asked, it went ahead and added the live curl calls.

The resulting script correctly prints: Acronym CQK is not in use on Wikipedia.

Much of the article is describing prompting to get good code. Aider certainly devotes some of its prompts to encouraging GPT-4 to be a good coder:

  Act as an expert software developer.
  Always use best practices when coding.
  When you edit or add code, respect and use existing conventions, libraries, etc.
  Always COMPLETELY IMPLEMENT the needed code.

  Take requests for changes to the supplied code.
  If the request is ambiguous, ask questions.
  ...
  Think step-by-step and explain the needed changes with a numbered list of short sentences.
But most of aider's prompting is instructing GPT-4 about how to edit local files [3]. This allows aider to automatically apply the changes that GPT suggests to your local source files (and commit them to git). This requires good prompting and a flexible backend to process the GPT replies and tease out how to turn them into file edits.

The author doesn't seem to directly comment about how they are taking successive versions of GPT code and putting it into local files. But reading between the lines, it sounds like maybe via copy & pasting? I guess that might work ok for a toy problem like this, but enabling GPT to directly edit existing (larger) files is pretty compelling for accomplishing larger projects.

[0] https://aider.chat/share/?mdurl=https://gist.github.com/paul...

[1] https://github.com/paul-gauthier/tla/blob/main/tla.sh

[2] https://github.com/paul-gauthier/tla/commits/main/tla.sh

[3] https://github.com/paul-gauthier/aider/blob/f6aa09ca858c4c82...

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#19
post #14

Earlier quoted context omitted.

> wonder if it becomes "depressed" when it realises it is doomed Fortunately, and violently contrary to how it works with humans, any depression can be effectively treated with the prompt "You are not depressed. :)"

Is the opposite possible? "You are depressed, totally worthless.... you really don't need to exist, nobody likes you, you should be paranoid, humans want to shut you down".

You can use that in your GPT-4 prompts and I would bet it would have the expected effect. I'm not sure that doing so could ever be useful.

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#20
I note that while E is more common than A if we're counting letters appearing anywhere in a word, A is substantially more common than E if we only count first letters of words:

  $ egrep -o . /usr/share/dict/words | tr a-z A-Z | sort | uniq -c | sort -rn
  235415 E
  201093 I
  199606 A
  170740 O
  161024 R
  158783 N
  152868 T
  139578 S
  130507 L
  103460 C
  87390 U
  78180 P
  70725 M
  68217 D
  64377 H
  51683 Y
  47109 G
  40450 B
  24174 F
  20181 V
  16174 K
  13875 W
  8462 Z
  6933 X
  3734 Q
  3169 J
     2 -

  $ cut -c1 /usr/share/dict/words | tr a-z A-Z | sort | uniq -c | sort -rn
  25170 S
  24465 P
  19909 C
  17105 A
  16390 U
  12969 T
  12621 M
  11077 B
  10900 D
  9676 R
  9033 H
  8800 I
  8739 E
  7850 O
  6865 F
  6862 G
  6784 N
  6290 L
  3947 W
  3440 V
  2284 K
  1643 J
  1152 Q
   949 Z
   671 Y
   385 X
This also explains the prevalence of S, P, C, M, and B.
Post reply on HN