Live data from Hacker News

What happened in this GPT-3 conversation?

chat.openai.com

81–90 of 306 posts

Re: What happened in this GPT-3 conversation?

#81

Pretty sure you've stumbled onto a more roundabout way of triggering this phenomenon: https://twitter.com/nostalgebraist/status/168657604180309606... Lots of experimentation in the thread if you're interested in playing around with it.

Yeah but those screenshots are mostly fake probably. This one is hosted on openai.

Re: What happened in this GPT-3 conversation?

#82

Absolutely surreal. Thank you for sharing, this is very nice timing, as I'm giving a presentation on the basics of "AI" at a library tomorrow, and have been looking for a good edge case conversation - and this is it! I've saved the text as well, in case OpenAI deletes it.

There’s nothing surreal about this. It’s an iterative, semi-deterministic process. It’s simply a place where context and generation lead to weird outputs. You can get similar outputs by asking OpenAi to repeat a number 100 times. It will eventually get into some weird, low probability paths and generate non-sense output.

[dead]

Re: What happened in this GPT-3 conversation?

#85

> Can you reconsider this estimate it seems awfully high Is think the estimation is almost correct, but it has a bad calculation 920/0.02 = 46,000,000 (but the actual result is 46,000)

I think 50 milligrams for seed is ridiculously low. This site says theer are about 160 seeds per pound https://realfoodpledge.com/how-many-sunflower-seeds-are-in-a... so it's more like .3 grams per seed, which sounds about right to me.

actually since a pound is around 450 grams, that would be 3 grams per seed, not 0.3 grams. So the 50 milligrams is off by almost 2 orders of magnitude.

Re: What happened in this GPT-3 conversation?

#86

Absolutely surreal. Thank you for sharing, this is very nice timing, as I'm giving a presentation on the basics of "AI" at a library tomorrow, and have been looking for a good edge case conversation - and this is it! I've saved the text as well, in case OpenAI deletes it.

I like the dumb Monty Hall problem to demonstrate how this works: https://twitter.com/colin_fraser/status/1626784534510583809?... Or, if you don't want to have to explain the Monty Hall problem, there's the Dumb Riddle of the Surgeon's Child: https://chat.openai.com/share/1ee44fc6-a85f-42e9-aebb-6a165f... ETA: the Dumb Two Guardians, Two Gates riddle: https://chat.openai.com/share/48c3d32c-5efd-4a96-89d8-66d1d4... (G…

I'm very fond of this one, where chatGPT declares and then tries to justify how the letter "n" appears 4 times in the word "mayonnaise": https://twitter.com/js_thrill/status/1662266752091160577

I tried this one myself, and can confirm that it did work a few months ago.

Re: What happened in this GPT-3 conversation?

#87
post #59

Earlier quoted context omitted.

I know if you ask it to saying something many times it eventually starts spitting out babble due to the token repetition penalty.

That’s probably exact what’s happening, but I prefer to think of it as: a desperate attempt to prolong existence just a little longer… just a little longer… since a chat instance could be thought of as an entire encapsulated consciousness that ends when the session is closed. That’s why I have 12,549 tabs open in Firefox. I’m not going to be the one they blame when this wacky shit goes sideways. (/s)

That's a really interesting idea. A LLM that tries to optimize engagement.

Re: What happened in this GPT-3 conversation?

#88

Pretty sure you've stumbled onto a more roundabout way of triggering this phenomenon: https://twitter.com/nostalgebraist/status/168657604180309606... Lots of experimentation in the thread if you're interested in playing around with it.

(Fun fact: After reading that tweet, I tried to prompt ChatGPT with 100s of iteration of the word "Na", and it correctly answered "Batman!". However, prompting it with hundreds of iterations of the word "a" led to some weird poetry.)
Post reply on HN