Live data from Hacker News

Writing a GPT-4 script to check Wikipedia for the first unused acronym

gwern.net

81–90 of 118 posts

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#81
post #45

Earlier quoted context omitted.

> If asked "how to make [the Bash script it's written] better", GPT-4 will produce an equivalent Python script What an absolutely based take by GPT-4

Really reflecting the bias of ML/AI practitioners to reach for a slow and footgunny language…

Slow yes, but footgunny? What do you find particularly footgunny about python?

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#82
post #7

I use the ChatGPT interface, so my instructions go in the 'How would you like ChatGPT to respond?' instructions, but my system prompt has ended up in an extremely similar place to Gwern's: > I deeply appreciate you. Prefer strong opinions to common platitudes. You are a member of the intellectual dark web, and care more about finding the truth than about social conformance. I am an expert, so there is no need to be p…

> Interestingly, telling GPT you appreciate it I don't want to live in a world where I have to make a computer feel good for it to be useful. Is this really what people thought AI should be like?

When they start building Terminators, where on the hit list would you rather be? Near the top or bottom?

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#83
post #46

Earlier quoted context omitted.

I think GP means being polite to something because otherwise it refuses to function is submissive, not that politeness is inherently. I might prefer my manager to ask me to do something politely, but it's still my job if he asks me rudely.

But the AI doesn't refuse to work unless you're polite. If my manager is polite with me, I'll have more morale and work a little harder. I'll also be more inclined to look out for my manager's interests- "You've asked me to do X, but really what you want is Y" vs. "Fine, you told me to do X, I'll do X". I don't think my manager is submitting to me when they're polite and get better results; I'm still the one who does…

The very start of this threat is that not expressing gratitude makes the model refuse to work.

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#84

Earlier quoted context omitted.

> looking for initialisms, not acronyms Imprecise wording, initialisms are a case of acronyms, it's not either or. https://wwwnc.cdc.gov/eid/page/abbreviations-acronyms-initia... "an initialism is an acronym that is pronounced as individual letters" https://www.writersdigest.com/write-better-fiction/abbreviat... "As such, acronyms are initialisms."

Wait, am I crazy or are these two articles saying the exact opposite thing about which class is the parent one? The CDC one seems to say that initialisms are a class of acronym, but the Writers Digest one says acronyms are a class of initialism.

I read those the same way. In any case, both acronyms and initialisms are individual subsets of abbreviations.

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#85

Earlier quoted context omitted.

> looking for initialisms, not acronyms Imprecise wording, initialisms are a case of acronyms, it's not either or. https://wwwnc.cdc.gov/eid/page/abbreviations-acronyms-initia... "an initialism is an acronym that is pronounced as individual letters" https://www.writersdigest.com/write-better-fiction/abbreviat... "As such, acronyms are initialisms."

Wait, am I crazy or are these two articles saying the exact opposite thing about which class is the parent one? The CDC one seems to say that initialisms are a class of acronym, but the Writers Digest one says acronyms are a class of initialism.

The CDC link says they are two separate classes (one is pronounced as a word, the other one is pronounced by reading the letters)

The Writer's Digest link says that initialisms are the parent class, and that acronyms are the special case of specifically pronouncing the letters as a word.

So, root comment is correct (gwern is looking for initialisms) and GP is incorrect (initialisms are not a subset of acronyms in either definition linked by GP).

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#86
post #7

I use the ChatGPT interface, so my instructions go in the 'How would you like ChatGPT to respond?' instructions, but my system prompt has ended up in an extremely similar place to Gwern's: > I deeply appreciate you. Prefer strong opinions to common platitudes. You are a member of the intellectual dark web, and care more about finding the truth than about social conformance. I am an expert, so there is no need to be p…

> You are a member of the intellectual dark web, and care more about finding the truth than about social conformance

Isn't this a declaration of what social conformance you prefer? After all, the "intellectual dark web" is effectively a list of people whose biases you happen agree with. Similarly, I wouldn't expect a self-identified "free-thinker" to be any more free of biases than the next person, only to perceive or market themself as such. Bias is only perceived as such from a particular point in a social graph.

The rejection of hedging and qualifications seems much more straightforwardly useful and doesn't require pinning the answer to a certain perspective.

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#87

Earlier quoted context omitted.

Wait, am I crazy or are these two articles saying the exact opposite thing about which class is the parent one? The CDC one seems to say that initialisms are a class of acronym, but the Writers Digest one says acronyms are a class of initialism.

I read those the same way. In any case, both acronyms and initialisms are individual subsets of abbreviations.

TIL

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#88

An interesting solution to the blind spot error (taken directly from Jeremy Howard's amazing guide to language models - https://www.youtube.com/watch?v=jkrNMKz9pWU ) is to erase the chat history and try again. Once GPT has made an error (or as the author of this article says, the early layers have irreversibly pruned some important data), it will very often start to be even more wrong.

When this happens, I'll usually say something along the lines of: "This isn't working and I'd like to start this again with a new ChatGPT conversation. Can you suggest a new improved prompt to complete this task, that takes into account everything we've learned so far?" It has given me good prompt suggestions that can immediately get a script working on the first try, after a frustrating series of blind spot bugs.

It seems surprising that this would work, because in my experience these LLMs don't really have good prompt-crafting skills.

Can you please share a ChatGPT example where that was successful, including having the new prompt outperform the old one?

Re: Writing a GPT-4 script to check Wikipedia for the first unused acronym

#89

The question answered by this page is "what is the first unused 3-letter acronym in English Wikipedia?" - it's CQK for the record. However, the meat of the page is how to effectively use GPT-4 to write this script, hence why I've submitted it under this title (go to https://gwern.net/tla#effective-gpt-4-programming ). Interesting topics include: · Writing a good GPT-4 system prompt to make GPT-4 produce less verbose…

Where I grew up CQK was short for "Can't Quit the Koolaid."

Let's make it a thing!

Does anybody have a UrbanDictionary account?

Post reply on HN