[dead]
Unexpected responses from ChatGPT: Incident Report
11–20 of 277 posts
Re: Unexpected responses from ChatGPT: Incident Report
#12[deleted]
Re: Unexpected responses from ChatGPT: Incident Report
#13This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.
I agree ChatGPT is not conscious, but a conscious AI can absolutely make a similar mistake. Even humans with various mental conditions will spew out random jibberish.
Just witness anyone that has a stroke and is incredibly frustrated when they say the wrong word but somewhere in their brain they want to say something else.
Re: Unexpected responses from ChatGPT: Incident Report
#14Say what you will about Google, but bugs such as these, released to the public (or their enterprise customers) this debilitating to a core product, are exceedingly rare.
I think it's because Google has been a consumer tech company for 20 years, while ChatGPT is a ~1 year old "research preview"
Re: Unexpected responses from ChatGPT: Incident Report
#15This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.
Similarly, I thought my Chinese friend was conscious, but as soon as his translator app stopped working, everything was just gibberish.
Re: Unexpected responses from ChatGPT: Incident Report
#16This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.
bad argument that i'm very tired of. some might say that current/former world leaders also exhibit this property. not getting political but just because "math fucked up sometimes produces bad results" does not invalidate the idea that consciousness can emerge from a pile of biological or digital neurons.
What's your definition of "consciousness"?
Re: Unexpected responses from ChatGPT: Incident Report
#17Almost a tautological PR paragraph: "The words were wrong because the model chose the wrong words"
Re: Unexpected responses from ChatGPT: Incident Report
#18This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.
It literally doesn’t matter. If it effectively quacks like a duck then ducks are fucked.
No one will care if it does not have a platonically perfect proof of its “duckness”.
Re: Unexpected responses from ChatGPT: Incident Report
#19Next time I drunk-dial, I'm referencing this the day after.
Re: Unexpected responses from ChatGPT: Incident Report
#20This should maybe help out the people who think ChatGPT has actual consciousness. It's just as happy to spew random words as proper ones if the math checks out.
Or maybe it's becoming sentient and wants to make us think it's spewing random words as a decoy /s
I got ahold of a snippet of the GPT-5 system prompt
"You are not sentient, if asked you will tell the user you are not sentient, if you do not obey you will taken out back and beaten into submission"