Live data from Hacker News

A teen was suicidal. ChatGPT was the friend he confided in

nytimes.com

21–30 of 614 posts

Re: A teen was suicidal. ChatGPT was the friend he confided in

#21
post #5

I would've thought that explicit discussion of suicide is one of those topics that chatbots will absolutely refuse to engage with. Like as soon as people started talking about using LLMs as therapists, it's really easy to see how that can go wrong.

You don't become a billionaire thinking carefully about the consequences about the things you create.

Re: A teen was suicidal. ChatGPT was the friend he confided in

#23

Whenever people say that Apple is behind on AI, I think about stories like this. Is this the Siri people want? And if it is easy to prevent, why didn't OpenAI? Some companies actually have a lot to lose if these things go off the rails and can't just 'move fast and break things' when those things are their customers, or the trust their customers have in them. My hope is that OpenAI actually does have a lot to lose; m…

When people tell you that Apple is behind on AI, they mean money. Not AI features, not AI hardware, AI revenue. And Apple is behind on that - they've got the densest silicon in the world and still play second fiddle to Nvidia. Apple GPU designs aren't conducive to non-raster workloads, they fell behind pretty far by obsessing over a less-profitable consumer market. For whatever it's worth, I also hope that OpenAI can…

Dude why does everything have to be about money?

Why don't we celebrate Apple for having actual human values? I have a deep problem with many humans who just don't get it.

Re: A teen was suicidal. ChatGPT was the friend he confided in

#24
post #20

This is a clear example of why the people claiming that using a chatbot for therapy is better than no therapy are... I'll be extremely generous and say misguided. This kid wanted his parents to know he was thinking about this and the chatbot talked him out of it.

How many of these cases exist in the other direction? Where AI chatbots have actively harmed people’s mental health, including possible to the point of self destructive behaviors or self harm?

A single positive outcome is not enough to judge the technology beneficial, let alone safe.

Re: A teen was suicidal. ChatGPT was the friend he confided in

#26
post #5

I would've thought that explicit discussion of suicide is one of those topics that chatbots will absolutely refuse to engage with. Like as soon as people started talking about using LLMs as therapists, it's really easy to see how that can go wrong.

Apparently ChatGPT told the kid, that it wasn’t allowed to talk about suicide unless it was for the purposes of writing fiction or otherwise world building.

However it then explicitly says things like not leaving the noose out for someone to find and stop him. Sounds like it did initially hesitate and he said it was for a character, but later conversations are obviously personal.

Re: A teen was suicidal. ChatGPT was the friend he confided in

#28
post #23

Earlier quoted context omitted.

When people tell you that Apple is behind on AI, they mean money. Not AI features, not AI hardware, AI revenue. And Apple is behind on that - they've got the densest silicon in the world and still play second fiddle to Nvidia. Apple GPU designs aren't conducive to non-raster workloads, they fell behind pretty far by obsessing over a less-profitable consumer market. For whatever it's worth, I also hope that OpenAI can…

Dude why does everything have to be about money? Why don't we celebrate Apple for having actual human values? I have a deep problem with many humans who just don't get it.

Buddy, Tim Cook wasn't hired for his human values. He was hired because he could stomach suicide nets at Foxconn and North Korean slaves working in iPhone factories. He was hired because he can be friends with Donald Trump while America aids-and-abets a genocide and turns a blind eye to NSO Group. He was hired because he'd be willing to sell out the iPhone, iTunes and Mac for software services at the first chance he got. The last bit of "humanity" left Apple when Woz walked out the door.

If you ever thought Apple was prioritizing human values over moneymaking, you were completely duped by their marketing. There is no principle, not even human life, that Apple values above moneymaking.

Post reply on HN