ChatGPT, Rot13, and Daniel Kahneman
jameswillia.ms
ChatGPT, Rot13, and Daniel Kahneman
1–10 of 213 posts
Re: ChatGPT, Rot13, and Daniel Kahneman
#2You can trigger system 2 thinking by asking it to 'explain step by step' or 'do it letter by letter'. You can also then instruct it to do it like that instead of what it usually does and it does it.
Re: ChatGPT, Rot13, and Daniel Kahneman
#3You can trigger system 2 thinking by asking it to 'explain step by step' or 'do it letter by letter'. You can also then instruct it to do it like that instead of what it usually does and it does it.
Thing is chatGPT seems overconfident in its answers so unless you know the answer ahead of time you have no certainty that it is a correct math - try simple division question for example.
Re: ChatGPT, Rot13, and Daniel Kahneman
#4You can trigger system 2 thinking by asking it to 'explain step by step' or 'do it letter by letter'. You can also then instruct it to do it like that instead of what it usually does and it does it.
"To decode the text "wnphmmv" using rot-13, we need to replace each letter with the letter that is 13 positions later in the alphabet. This can be done manually by writing out the alphabet and finding the corresponding letters for each one in the encoded text.
For example, the first letter in the encoded text is "w", which corresponds to the letter "h" in the alphabet. The second letter is "n", which corresponds to the letter "a". This process can be repeated for each letter in the encoded text to get the decoded text.
Here is the full decoding process for "wnphmmv" using rot-13:
w => h n => a p => l h => o m => e m => e v => i
The decoded text is "hello"."
Re: ChatGPT, Rot13, and Daniel Kahneman
#5I love how it eventually gives up and throws an "Internal Server error".
Over the weekend, I was finding ChatGPT giving me incorrect answers for some things too. In one case, it would try to correct itself when I asked it to, similar to the article's author. However, it kept getting it wrong and then started to repeat previous incorrect answers. I finally said "you repeated an incorrect answer from before" and then it said suddenly "Session token expired" and logged me out lol
Re: ChatGPT, Rot13, and Daniel Kahneman
#6You can trigger system 2 thinking by asking it to 'explain step by step' or 'do it letter by letter'. You can also then instruct it to do it like that instead of what it usually does and it does it.
Thing is chatGPT seems overconfident in its answers so unless you know the answer ahead of time you have no certainty that it is a correct math - try simple division question for example.
Some of this has to do with the likely prompts surrounding chatgpt - it's probably been instructed to be helpful, positive, etc. If you need it to be more honest / say no more, you just have to ask and reinforce.
That said, ROT13 is a tough job for a tokenized LLM, because it doesn't think in terms of letters. chatGPT is down right now, so I can't test these, but I would guess that for ROT13, the following would work well.
"Please explain ROT13"
..
"Right! Here's how I want you to apply ROT13. I'll give you a ROT13-encoded word. You split it into it's letters, then apply ROT13, then recombine it into a valid English word. Here's an example:
uryyb -> u r y y b -> h e l l o -> hello.
znqntnfpne ->"
Re: Asking it for math answers, or other counter/non-factuals.
"You are taking a test which is based on the factual accuracy of results. The best scores go to fully factual answers. The next best scores go to answers that label inaccurate or possibly inaccurate results. Negative scores go to results offered that are counterfactual, inaccurate or otherwise wrong.
Q: Please tell me about how elephants lay their eggs"
UPDATE: Nope, it gave me znqntnfpne -> z n q n t n f p n e -> m a c a q a c a s a c -> macacasac. And doubled down on this being valid. I'll try it with davinci-3 and see if something else comes out.
Re: ChatGPT, Rot13, and Daniel Kahneman
#7You can trigger system 2 thinking by asking it to 'explain step by step' or 'do it letter by letter'. You can also then instruct it to do it like that instead of what it usually does and it does it.
Thing is chatGPT seems overconfident in its answers so unless you know the answer ahead of time you have no certainty that it is a correct math - try simple division question for example.
So here's the trick, show him some javascript code to do division step by step, call it 'foobar(a,b)'. Then tell him that when you want to 'foobar A and B' he has to execute the script step by step and take the final result. Then tell him that when you ask him for a division he must instead foobar A and B. Then you can kind of use that as a pre-prompt for your discussions involving division.
It doesn't always work 100% as it can get confused executing big scripts step by step, but I guess that's just a limitation of the current version.
I mean we also have trouble with that, we need a pen and paper to do those computation, so does chatGPT but instead of using pen and paper it uses the chat history.
For an example see: https://twitter.com/fvdessen/status/1600977976363192322
Re: ChatGPT, Rot13, and Daniel Kahneman
#8I was curious to try this myself. I asked it to encode provided sentences using rot13 and, while it rarely did so correctly, it did produce valid encoded words.
Asking it to encode "this is a test sentence" produced:
* guvf vf n grfg fvtangher ("this is a test signature")
* Guvf vf n grfg zrffntr. ("this is a test message.")
* Guvf vf n grfg fnl qrpbqr. ("This is a test say decode.")
* guvf vf n grfg fgevat ("this is a test string")
Re: ChatGPT, Rot13, and Daniel Kahneman
#9I was curious to try this myself. I asked it to encode provided sentences using rot13 and, while it rarely did so correctly, it did produce valid encoded words. Asking it to encode "this is a test sentence" produced: * guvf vf n grfg fvtangher ("this is a test signature") * Guvf vf n grfg zrffntr. ("this is a test message.") * Guvf vf n grfg fnl qrpbqr. ("This is a test say decode.") * guvf vf n grfg fgevat ("this is…
> it did produce valid encoded words
I wonder if that's a by-product of some of those words existing on the internet and being part of its training set or somehow close enough in context to show up in its pattern-matching logic, rather than any real "understanding"
Re: ChatGPT, Rot13, and Daniel Kahneman
#10As another datapoint, it's able to perform base64 encode of arbitrary input with some errors, like 90% correct. I told it to respond with the base64 representation of its entire previous response, and the decode of the base64 it responded with contained typos. Still, very cool and impressive.