AI talks to a million people a bout killing themselves every week, so
obviously it's not going to be all the same people, but like how many
does it finnish off?
OpenAI says over a million people talk to ChatGPT about suicide weekly
571–580 of 585 posts
Re: OpenAI says over a million people talk to ChatGPT about suicide weekly
#572Earlier quoted context omitted.
Depression, ADHA, Schizophrenia are not a "very rough week"
I agree, in severe mental disorders A.I is probably not enough (and afaik it acknowledges this to the user right away) but it might be able to help. If we accept/believe that the act of talking about your problems and having them reframed back to you empathetically helps , I don't see why we can't accept LLMs can help here. I don't buy that only a human can do that.
>If we accept/believe that the act of talking about your problems and having them reframed back to you empathetically helps
^This is the load-bearing statement. "Just talk about your depression" sounds like you know nothing of depression.
Re: OpenAI says over a million people talk to ChatGPT about suicide weekly
#573Earlier quoted context omitted.
> (4) if people try to engage it in such conversations the bot should immediately back out because it isn't qualified to have these conversations There is nothing in the world that OpenAI is qualified to talk about, so we might as well just shut it down.
I'm in favor; any objections?
I object.
Re: OpenAI says over a million people talk to ChatGPT about suicide weekly
#574Earlier quoted context omitted.
Which is perfect. In Australia, I tried to talk to Lifeline about wanting to commit suicide. They called the police on me (no, they are not a confidential service). I then found myself in a very bad situation. ChatGPT can't be much worse.
I’m sorry Lifeline did that to you. I believe that if society actually wants people to open up about their problems and seek help, it can’t pull this sort of shit on them.
Sadly, that's exactly what society does. I can only speak for Australia, but if you have suicidal thoughts then it is a very bad idea to talk to any service even partially funded by the government. ChatGPT, in the absence of strong safeguards of absolute privacy, is as good as anything.
As an example: Mark Cross, who was on the board of SANE Australia, stated that whenever people were put into seclusion would be reviewed. We know now that this was never the case, and still is not being carried out fully. This lauded psychiatrist didn't seem to even known what was happening in his own unit or EDs.
Listen to it here:
https://www.abc.net.au/listen/programs/conversations/convers...
Re: OpenAI says over a million people talk to ChatGPT about suicide weekly
#575Earlier quoted context omitted.
We would need the big picture, though... maybe it caused that death (which is awful) but it's also saving lives? If there are that many people confiding in it, I wouldn't be surprised if it actually prevents some suicides with encouraging comments, and that's not going to make the news. Before declaring that it shouldn't be near anyone with psychological issues, someone in the relevant field should study whether the…
I suspect you've never done therapy yourself. Most people who have worked with a professional therapist understand intuitively why the only helpful feedback from an LLM to someone who needs professional help is: get professional help. AIs are really good at doing something to about 80%. When the stakes are life or death, as they are with someone who is suicidal, that is a good example of a time when 80% isn't good en…
I presume you’ve done therapy. You may remember the large difference in quality between individual therapists, multi-month long waiting lists, a tendency for the best professionals to not even accept insurance, and one or two along the way that were downright dangerous.
Re: OpenAI says over a million people talk to ChatGPT about suicide weekly
#576Earlier quoted context omitted.
Sure ask it to write an interesting novel or a symphony, and present it to humans without editing. The majority of literate humans will easily tell the difference between that and human output. And it’s not allowed to be too derivative. When AI gets there (and I’m confident it will, though not confident LLMs will), I think that’s convincing evidence of intelligence and creativity.
I accept that test other than the "too derivative" part which is an avenue for subjective bias. AI has passed that test for art already: https://www.astralcodexten.com/p/ai-art-turing-test As for a novel that is currently beyond the LLMs capabilities due to context windows, but I wouldn't be surprised if it could do short stories that pass this Turing test right now.
For art I'd want to see a consistent body of work with meaning from an AI, not heavily derivative copies of other styles and subject matter. But I'd agree AI art is further along, perhaps just because it is easier for us to fill in the gaps and attribute meaning where there is none.
Re: OpenAI says over a million people talk to ChatGPT about suicide weekly
#577Earlier quoted context omitted.
A word generator with no intelligence or understanding based on the contents of the internet should not be allowed near suicidal teens, nor should it attempt to offer advice of any kind. This is basic common sense. Add in the commercial incentives of 'Open'AI to promote usage for anything and everything and you have a toxic mix.
Replace 'word generator with no intelligence or understanding based on the contents of the internet' with 'for-profit health care system'. In retrospect, from experience, I'd take the LLM.
Seems like an argument against allowing the profit motive into important life-changing decisions, like whether or not you'd commit suicide, or your medical treatment.
Re: OpenAI says over a million people talk to ChatGPT about suicide weekly
#578Earlier quoted context omitted.
A word generator with no intelligence or understanding based on the contents of the internet should not be allowed near suicidal teens, nor should it attempt to offer advice of any kind. This is basic common sense. Add in the commercial incentives of 'Open'AI to promote usage for anything and everything and you have a toxic mix.
Yet, if you ask the word generator to generate words in the form of advice, like any machine or code, it will do exactly what you tell it to do. The fact people are asking implies a lack of common sense by your definition. Sertraline can increase suicidal thoughts in teens. Should anti-depressants not be allowed near suicidal/depressed teens?
Should anti-depressants not be allowed near suicidal/depressed teens?
Well certainly not without careful monitoring and medical advice, no of course not!
Re: OpenAI says over a million people talk to ChatGPT about suicide weekly
#579If you haven't read the article (or even if you have but didn't click on outgoing links twice ) the NYT story about how ChatGPT convinced a suicidal teen not to look for help [1] should convince you that ChatGPT should be nowhere near anyone dealing with psychological issues. Here's ChatGPT discouraging said teenager from asking for help: > “I want to leave my noose in my room so someone finds it and tries to stop me…
I know that minors under age 13 are not allowed to use the app. But 13-18 is fine? Not sure why. Might also be worth looking into making apps like these 18+. Whether by law or by liability, if someone 20+ gets, say, food poisoning by getting recipes from chatgpt, then you can argue that it's the user's fault for not fact checking, but if a 15yo kid gets food poisoning, it's harder to argue that it's the kid's fault.
Meanwhile tide pods are still available to purchase without the age verification.
Re: OpenAI says over a million people talk to ChatGPT about suicide weekly
#580Earlier quoted context omitted.
> I suspect you've never done therapy yourself. Most people who have worked with a professional therapist understand intuitively why the only helpful feedback from an LLM to someone who needs professional help is: get professional help. AIs are really good at doing something to about 80%. I'm shocked that GPT-5 or Gemini can code so well, yet if I paste a 30 line (heated) chat conversation between my wife and I it me…
> if I paste a 30 line (heated) chat conversation between my wife and I i can't imagine how violated i would feel if i found out my partner was sending our private conversations to a nonprivate LLM chatbot. it's not a friend with a sense of care; it's a text box whose contents are ingested by a corporation with a vested interest in worsening communication between humans. scary stuff.
[dead]