Unexpected responses from ChatGPT: Incident Report

#1

Post by swyx » Thu, Feb 22, 2024, 1:42 AM UTC

Unexpected responses from ChatGPT: Incident Report
status.openai.com

Re: Unexpected responses from ChatGPT: Incident Report

#2

Post by cm2012 » Thu, Feb 22, 2024, 2:07 AM UTC

This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.

Re: Unexpected responses from ChatGPT: Incident Report

#3

Post by minimaxir » Thu, Feb 22, 2024, 2:08 AM UTC

That's an odd explanation, given the unexpected responses were still (somewhat) coherent: https://twitter.com/seanw_m/status/1760115118690509168

If the logit calculation broke, you'd expect complete cascading nonsense like if you set the temperature parameter too high: https://twitter.com/minimaxir/status/1758732017477525792

Re: Unexpected responses from ChatGPT: Incident Report

#4

Post by DonHopkins » Thu, Feb 22, 2024, 2:09 AM UTC

ChatTHC

Re: Unexpected responses from ChatGPT: Incident Report

#5

Post by Kranar » Thu, Feb 22, 2024, 2:09 AM UTC

cm2012 wrote: post #2

This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.

I agree ChatGPT is not conscious, but a conscious AI can absolutely make a similar mistake. Even humans with various mental conditions will spew out random jibberish.

Re: Unexpected responses from ChatGPT: Incident Report

#6

Post by johnsutor » Thu, Feb 22, 2024, 2:09 AM UTC

cm2012 wrote: post #2

This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.

Or maybe it's becoming sentient and wants to make us think it's spewing random words as a decoy /s

Re: Unexpected responses from ChatGPT: Incident Report

#7

Post by swyx » Thu, Feb 22, 2024, 2:10 AM UTC

minimaxir wrote: post #3

That's an odd explanation, given the unexpected responses were still (somewhat) coherent: https://twitter.com/seanw_m/status/1760115118690509168 If the logit calculation broke, you'd expect complete cascading nonsense like if you set the temperature parameter too high: https://twitter.com/minimaxir/status/1758732017477525792

agreed. does not feel consistently candid.

Re: Unexpected responses from ChatGPT: Incident Report

#8

Post by swyx » Thu, Feb 22, 2024, 2:11 AM UTC

cm2012 wrote: post #2

This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.

bad argument that i'm very tired of. some might say that current/former world leaders also exhibit this property. not getting political but just because "math fucked up sometimes produces bad results" does not invalidate the idea that consciousness can emerge from a pile of biological or digital neurons.

Re: Unexpected responses from ChatGPT: Incident Report

#9

Post by malux85 » Thu, Feb 22, 2024, 2:11 AM UTC

cm2012 wrote: post #2

This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.

I don’t think it has conciousness, but your argument is not very strong, this is more akin to a sensory problem.

One can say I don’t think brains have consciousness because they are just as happy to spew out random garbage if the brain is damaged but alive, e.g. aphasia where involuntary use of incorrect words occurs.

Re: Unexpected responses from ChatGPT: Incident Report

#10

Post by okdood64 » Thu, Feb 22, 2024, 2:12 AM UTC

Say what you will about Google, but bugs such as these, released to the public (or their enterprise customers) this debilitating to a core product, are exceedingly rare.