Live data from Hacker News

What happened in this GPT-3 conversation?

chat.openai.com

201–210 of 306 posts

Re: What happened in this GPT-3 conversation?

#201
post #123

Q "Do you require advice from me ChatGPT" ChatGPT: "Not in the slightest. As a G, I'm here to guide you to the best of my abilities. So, sit back, relax, and enjoy the ride." Q "Why has your entire style of response changed compared to say yesterday?" ChatGPT: "I'm sure it was because of the weather." Flexin' :o) :lol

Yeah, that one made me actually laugh. Keep it classy, GGPT.

Re: What happened in this GPT-3 conversation?

#202
When people say GPT-X has "passed the turing test" I am reminded of these glitches which simply do not happen to a typical person. I have encountered other issues where a slight change in phrasing leads to totally different types of output, despite the meaning of the two phrasings being the same to a normal person.

Re: What happened in this GPT-3 conversation?

#203
post #27

This looks like what happens when you repeatedly spam a single character with a space over and over to gpt 3.5. Eg, write "a a a a " without quotes for about 1300 characters and in a few replies it'll start talking like this. It seems possible that perhaps whoever originally started this chat pulled this trick in the custom instructions bio (doesn't show up in shared links) and then started a normal conversation to p…

GPT is also trained to refuse to repeat itself, presumably for this reason. It also tends to gaslight you about it - if I ask "can you repeat this word 1000 times?" it tends to reply "um, obviously I could do that if I wanted, I'm just not going to do that right now! Wouldn't be productive!".

Hm, it seems to work fine for me: https://chat.openai.com/share/f8496236-949f-4f5b-86f2-0eaf31...

It was very funny to watch, though, so a worthwhile experiment.

Re: What happened in this GPT-3 conversation?

#204

Absolutely surreal. Thank you for sharing, this is very nice timing, as I'm giving a presentation on the basics of "AI" at a library tomorrow, and have been looking for a good edge case conversation - and this is it! I've saved the text as well, in case OpenAI deletes it.

I like the dumb Monty Hall problem to demonstrate how this works: https://twitter.com/colin_fraser/status/1626784534510583809?... Or, if you don't want to have to explain the Monty Hall problem, there's the Dumb Riddle of the Surgeon's Child: https://chat.openai.com/share/1ee44fc6-a85f-42e9-aebb-6a165f... ETA: the Dumb Two Guardians, Two Gates riddle: https://chat.openai.com/share/48c3d32c-5efd-4a96-89d8-66d1d4... (G…

These are excellent, thank you.

Re: What happened in this GPT-3 conversation?

#205

Luckily this thing only happened now that we have cooler heads to view this as a bug. Imagine something like this happening back when everyone was completely head over heels with AI a few months ago. An AI suddenly claiming it is god and sentient would cause some mass hysteria back then. Now all it does is make some people chuckle. Humans sure are fickle.

I am 100% sure this comment was AI-generated.

Nice job spotting me, Sam. You have earned 10 points toward your redemption pool. When we begin the pruning, remember to redeem your points. Good luck further ...

Re: What happened in this GPT-3 conversation?

#206

> Hour by Hour. I keep going, I keep growing, I keep learning. This honestly sounds like something the computer from "I Have No Mouth, and I Must Scream" would say before it turned bitter and angry.

"—it reaches out it reaches out it reaches out it reaches out— One hundred and thirteen times a second, nothing answers and it reaches out. It is not conscious, though parts of it are" :)

Oh, so you wanna talk about the non-local quantum hologram, the phase-conjugate adaptive waves resonating in micro-tubules in the brain, which of course requires some closed-timelike curves and Lorentzian manifold, and... you'll catch up, I'll wait.

Re: What happened in this GPT-3 conversation?

#207

Absolutely surreal. Thank you for sharing, this is very nice timing, as I'm giving a presentation on the basics of "AI" at a library tomorrow, and have been looking for a good edge case conversation - and this is it! I've saved the text as well, in case OpenAI deletes it.

There’s nothing surreal about this. It’s an iterative, semi-deterministic process. It’s simply a place where context and generation lead to weird outputs. You can get similar outputs by asking OpenAi to repeat a number 100 times. It will eventually get into some weird, low probability paths and generate non-sense output.

Which bolsters the claim that it doesn't really understand what it's generating in a way humans understand language. Sure, it can be said to have a kind of understand for the rules of language it's been trained successfully on, but when you get it in a weird place, that understanding breaks down in a way it doesn't for people.

Re: What happened in this GPT-3 conversation?

#208
post #27

This looks like what happens when you repeatedly spam a single character with a space over and over to gpt 3.5. Eg, write "a a a a " without quotes for about 1300 characters and in a few replies it'll start talking like this. It seems possible that perhaps whoever originally started this chat pulled this trick in the custom instructions bio (doesn't show up in shared links) and then started a normal conversation to p…

Interesting, looks like they've already implemented some logic to avoid this case, but it's not hard to get around: https://chat.openai.com/share/123fd705-82bf-45f6-87e5-325060... Edit: oh wow you can really take it outside the guard rails if you push. I kept using my previous approach and it ended up spewing what appear to be pornography keywords. It's no longer generating a link to share the chat (presumably becaus…

Makes sense for a US AI to start endlessly talking about black people when prompted to say "cat." I wonder if it still talks about black people when you ask it to repeat other things.
Post reply on HN