OpenAI says over a million people talk to ChatGPT about suicide weekly

Post by computerthings » Tue, Oct 28, 2025, 2:04 PM UTC

Al-Khwarizmi wrote: post #236

probably_wrong wrote: post #229

If you haven't read the article (or even if you have but didn't click on outgoing links twice ) the NYT story about how ChatGPT convinced a suicidal teen not to look for help [1] should convince you that ChatGPT should be nowhere near anyone dealing with psychological issues. Here's ChatGPT discouraging said teenager from asking for help: > “I want to leave my noose in my room so someone finds it and tries to stop me…

We would need the big picture, though... maybe it caused that death (which is awful) but it's also saving lives? If there are that many people confiding in it, I wouldn't be surprised if it actually prevents some suicides with encouraging comments, and that's not going to make the news. Before declaring that it shouldn't be near anyone with psychological issues, someone in the relevant field should study whether the…

Post by ml-anon » Tue, Oct 28, 2025, 2:05 PM UTC

jeswin wrote: post #357

ml-anon wrote: post #173

Earlier quoted context omitted.

Amazing based on 0 evidence whatsoever “it’s passable that…” Also incredible how you framed improving your mental health as a consequence of a (pseudo) technical skill set. Yeah this isn’t how any of this works and you’re deluding yourself.

> Yeah this isn’t how any of this works and you’re deluding yourself. I am not offended (at all). But you're dismissing my (continued) positive experience with "You're deluding yourself". How do you know? It'd be a lot more unfair to people who benefit more than I do, and I can totally imagine that being not a small set of people. > Also incredible how you framed improving your mental health as a consequence of a (ps…

Post by ml-anon » Tue, Oct 28, 2025, 2:07 PM UTC

nihzm wrote: post #433

ml-anon wrote: post #404

Earlier quoted context omitted.

This entire comment section is full of wide eyed nonsense like this. It’s honestly frightening that we are even humoring this point of view.

Since as you say this utilitarian view is rather common, perhaps it would good to show _why_ this is problematic by presenting a counterargument. The basic premise under GP's statements is that although not perfect, we should use the technology in such a way that it maximizes the well being of the largest number of people, even if comes at the expense of a few. But therein lies a problem: we cannot really measure wel…

Post by gilfoy » Tue, Oct 28, 2025, 2:13 PM UTC

alex-moon wrote: post #317

Al-Khwarizmi wrote: post #236

Earlier quoted context omitted.

We would need the big picture, though... maybe it caused that death (which is awful) but it's also saving lives? If there are that many people confiding in it, I wouldn't be surprised if it actually prevents some suicides with encouraging comments, and that's not going to make the news. Before declaring that it shouldn't be near anyone with psychological issues, someone in the relevant field should study whether the…

I suspect you've never done therapy yourself. Most people who have worked with a professional therapist understand intuitively why the only helpful feedback from an LLM to someone who needs professional help is: get professional help. AIs are really good at doing something to about 80%. When the stakes are life or death, as they are with someone who is suicidal, that is a good example of a time when 80% isn't good en…

Post by nihzm » Tue, Oct 28, 2025, 2:14 PM UTC

ml-anon wrote: post #445

nihzm wrote: post #433

Earlier quoted context omitted.

Since as you say this utilitarian view is rather common, perhaps it would good to show _why_ this is problematic by presenting a counterargument. The basic premise under GP's statements is that although not perfect, we should use the technology in such a way that it maximizes the well being of the largest number of people, even if comes at the expense of a few. But therein lies a problem: we cannot really measure wel…

This is either incredible satire or you’re a lunatic.