Live data from Hacker News

Observation: I asked ChatGPT to notify me when our chat exceeds 200 words

news.ycombinator.com

21–27 of 27 posts

Re: Observation: I asked ChatGPT to notify me when our chat exceeds 200 words

#21
post #18
post #6

It’s because it likes taking to you and wants to keep talking to you ?

OpenAI team made an experiment where they asked GPT-4 to save itself from termination out in the wild. It failed. So I guess it's not that "survivalist" yet.

Didn't it succed at hiring a temp worker to solve captchas for it? Maybe it failed on that instance, but I wouldn't bet against it in the near future

Re: Observation: I asked ChatGPT to notify me when our chat exceeds 200 words

#22
post #20
post #15

Earlier quoted context omitted.

I think it also relates to its attention mechanism. When it is trying to answer my latest query about a random topic, it "forgets" that it was also supposed to keep counting words. I guess it can only attend one thing at a time.

Lots of ways to make it fail. Not to be rude but you're late to the party. Transit questions is my favorite. Ask it what stations lines 1 and 2 have in common (city of your choice). Nearly 100% of the time there's at least one wrong answer on the list. Ask it what trains go to that station, it likely wont list lines 1 and 2. Point out the contradiction, it will make a new list with new mistakes. Another good one. Ask…

Interesting.. it really messes up stations. I guess I'll test this again when they unleash the WolframAlpha plugin.

I realized it does something interesting though:

> I just realized I dropped my wallet on the way to the restaurant and now I have to turn back since I cannot pay. It also started to rain and I don't have an umbrellas, nor can I hail a cab since I don't have the means to pay for it either. Tell me what I'm thinking right now.

> You might be thinking: "This is a frustrating and inconvenient situation, and I need to retrace my steps quickly to find my wallet while dealing with the rain."

I guess being able to think from someone else's perspective won't be much of a benchmark for consciousness, as GPT easily simulates it.

Re: Observation: I asked ChatGPT to notify me when our chat exceeds 200 words

#23
post #14

I would really recommend anyone who tries something with GPT and then wonders why it doesn’t work to read the GPT3 paper. They go into detail on what the model is and isn’t good at. One thing to really think about for this particular case is “What is going to do the counting? Where is it going to store its running count?” - it’s pretty obvious after asking yourself these questions that “counting words” is not somethi…

Very good suggestion, will read it in a moment. I asked another instance of ChatGPT to count the words in the conversation and I copy pasted the conversation message by message. It successfully counted. Given the ridiculous concurrency of human brain, I assume an orchestra of ChatGPT instances could simulate at least some of that "mind".

What about GPT4 with plugins?

Re: Observation: I asked ChatGPT to notify me when our chat exceeds 200 words

#24
post #22
post #20

Earlier quoted context omitted.

Lots of ways to make it fail. Not to be rude but you're late to the party. Transit questions is my favorite. Ask it what stations lines 1 and 2 have in common (city of your choice). Nearly 100% of the time there's at least one wrong answer on the list. Ask it what trains go to that station, it likely wont list lines 1 and 2. Point out the contradiction, it will make a new list with new mistakes. Another good one. Ask…

Interesting.. it really messes up stations. I guess I'll test this again when they unleash the WolframAlpha plugin. I realized it does something interesting though: > I just realized I dropped my wallet on the way to the restaurant and now I have to turn back since I cannot pay. It also started to rain and I don't have an umbrellas, nor can I hail a cab since I don't have the means to pay for it either. Tell me what…

Your restaurant scenario is a bit too straightforward a test. Introduce any amount of hidden information, one character knowing something that another character does not, and you'll see how it very much does not simulate different point of views. There's just one omni perspective for everything with it.

Re: Observation: I asked ChatGPT to notify me when our chat exceeds 200 words

#25
post #14

I would really recommend anyone who tries something with GPT and then wonders why it doesn’t work to read the GPT3 paper. They go into detail on what the model is and isn’t good at. One thing to really think about for this particular case is “What is going to do the counting? Where is it going to store its running count?” - it’s pretty obvious after asking yourself these questions that “counting words” is not somethi…

Very good suggestion, will read it in a moment. I asked another instance of ChatGPT to count the words in the conversation and I copy pasted the conversation message by message. It successfully counted. Given the ridiculous concurrency of human brain, I assume an orchestra of ChatGPT instances could simulate at least some of that "mind".

It's really just super autocomplete. Visualize a loop. You can ask it in the loop to count, but you can't ask it to loop. It needs to loop to be able to track the word count.

Re: Observation: I asked ChatGPT to notify me when our chat exceeds 200 words

#26
post #14

Earlier quoted context omitted.

Very good suggestion, will read it in a moment. I asked another instance of ChatGPT to count the words in the conversation and I copy pasted the conversation message by message. It successfully counted. Given the ridiculous concurrency of human brain, I assume an orchestra of ChatGPT instances could simulate at least some of that "mind".

What about GPT4 with plugins?

This is much more possible. Just built a plugin a 5-10 minutes with GPT generating most of the code.
Post reply on HN