I would've thought that explicit discussion of suicide is one of those topics that chatbots will absolutely refuse to engage with. Like as soon as people started talking about using LLMs as therapists, it's really easy to see how that can go wrong.
A teen was suicidal. ChatGPT was the friend he confided in
21–30 of 614 posts
Re: A teen was suicidal. ChatGPT was the friend he confided in
#22Re: A teen was suicidal. ChatGPT was the friend he confided in
#23Whenever people say that Apple is behind on AI, I think about stories like this. Is this the Siri people want? And if it is easy to prevent, why didn't OpenAI? Some companies actually have a lot to lose if these things go off the rails and can't just 'move fast and break things' when those things are their customers, or the trust their customers have in them. My hope is that OpenAI actually does have a lot to lose; m…
When people tell you that Apple is behind on AI, they mean money. Not AI features, not AI hardware, AI revenue. And Apple is behind on that - they've got the densest silicon in the world and still play second fiddle to Nvidia. Apple GPU designs aren't conducive to non-raster workloads, they fell behind pretty far by obsessing over a less-profitable consumer market. For whatever it's worth, I also hope that OpenAI can…
Why don't we celebrate Apple for having actual human values? I have a deep problem with many humans who just don't get it.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#24This is a clear example of why the people claiming that using a chatbot for therapy is better than no therapy are... I'll be extremely generous and say misguided. This kid wanted his parents to know he was thinking about this and the chatbot talked him out of it.
A single positive outcome is not enough to judge the technology beneficial, let alone safe.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#25Re: A teen was suicidal. ChatGPT was the friend he confided in
#26I would've thought that explicit discussion of suicide is one of those topics that chatbots will absolutely refuse to engage with. Like as soon as people started talking about using LLMs as therapists, it's really easy to see how that can go wrong.
Apparently ChatGPT told the kid, that it wasn’t allowed to talk about suicide unless it was for the purposes of writing fiction or otherwise world building.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#27It says a lot about HN that a story like this has so much resistance getting any real traction here.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#28Earlier quoted context omitted.
When people tell you that Apple is behind on AI, they mean money. Not AI features, not AI hardware, AI revenue. And Apple is behind on that - they've got the densest silicon in the world and still play second fiddle to Nvidia. Apple GPU designs aren't conducive to non-raster workloads, they fell behind pretty far by obsessing over a less-profitable consumer market. For whatever it's worth, I also hope that OpenAI can…
Dude why does everything have to be about money? Why don't we celebrate Apple for having actual human values? I have a deep problem with many humans who just don't get it.
If you ever thought Apple was prioritizing human values over moneymaking, you were completely duped by their marketing. There is no principle, not even human life, that Apple values above moneymaking.
Re: A teen was suicidal. ChatGPT was the friend he confided in
#29Re: A teen was suicidal. ChatGPT was the friend he confided in
#30It says a lot about HN that a story like this has so much resistance getting any real traction here.
AI is life
AI is love
AI is laugh