A teen was suicidal. ChatGPT was the friend he confided in
1–10 of 614 posts
Re: A teen was suicidal. ChatGPT was the friend he confided in
#2Re: A teen was suicidal. ChatGPT was the friend he confided in
#3this is devestating. reading these messages to and from the computer would radicalize anybody. the fact that the computer would offer a technical analysis of how to tie a noose is damning. openai must be compelled to protect the users when they're clearly looking to harm themselves. it is soulless to believe this is ok.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#4Excerpts from the complaint here. Horrible stuff.
https://bsky.app/profile/sababausa.bsky.social/post/3lxcwwuk...
Re: A teen was suicidal. ChatGPT was the friend he confided in
#5I would've thought that explicit discussion of suicide is one of those topics that chatbots will absolutely refuse to engage with. Like as soon as people started talking about using LLMs as therapists, it's really easy to see how that can go wrong.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#6[flagged]
Re: A teen was suicidal. ChatGPT was the friend he confided in
#7I would've thought that explicit discussion of suicide is one of those topics that chatbots will absolutely refuse to engage with. Like as soon as people started talking about using LLMs as therapists, it's really easy to see how that can go wrong.
Well everyone seemed to turn on the AI ethicists as cowards a few years ago, so I guess this is what happens.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#8[flagged]
There was no suicide hotline offered either. Strange because youtube always gives me one whenever I search the band 'suicidal tendencies'.
Giving medical advice is natural and intelligent, like saying take an aspirin. I'm not sure where to draw the line.
My friends are always recommending scam natural remedies like methylene blue. There are probably discords where people tell you 'down the road, not across the street' referring to cutting.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#9Excerpts from the complaint here. Horrible stuff. https://bsky.app/profile/sababausa.bsky.social/post/3lxcwwuk...
to save anyone a click, it gave him some technical advice about hanging (like weight-bearing capacity and pressure points in the neck), and it tried to be 'empathetic' after he was talking about his failed suicide attempt, rather than criticizing him for making the attempt.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#10Whenever people say that Apple is behind on AI, I think about stories like this. Is this the Siri people want? And if it is easy to prevent, why didn't OpenAI?
Some companies actually have a lot to lose if these things go off the rails and can't just 'move fast and break things' when those things are their customers, or the trust their customers have in them.
My hope is that OpenAI actually does have a lot to lose; my fear is that the hype and the sheer amount of capital behind them will make them immune from real repercussions.