Live data from Hacker News

Can A.I. be blamed for a teen's suicide?

nytimes.com

41–50 of 142 posts

Re: Can A.I. be blamed for a teen's suicide?

#41
post #25

Earlier quoted context omitted.

"He expressed being scared, wanting her affection and missing her. She replies, 'I miss you too,' and she says, 'Please come home to me.' He says, 'What if I told you I could come home right now?' and her response was, 'Please do my sweet king.'"

This reads like serial experiments lain, or any number of weird Japanese love/horror stories

My thoughts exactly.

Did you see the weird Lain chatbot they released last year?

Re: Can A.I. be blamed for a teen's suicide?

#42

Earlier quoted context omitted.

I searched in vain for a correlation between suicide rates by country and gun ownership rates by country. Nothing... Yours is an argument of the form: "He was stabbed by a knife. Do let's not talk about why, let's just make it harder to get a knife, since that is how he died." Maybe gun access should be harder, maybe it should not. That is not relevant. The issue is that an impressionable youth was talked into suicid…

> He was stabbed by a knife. Do let's not talk about why, let's just make it harder to get a knife, since that is how he died. > [The] issue is that an impressionable youth was talked into suicide by an LLM and nobody stopped it. Right, that is the issue. Except, I disagree there's enough evidence for a reasonable person to conclude that the chatbot talked him into shooting himself. Where as there is plenty of eviden…

> What other steps are there that could have prevented this suicide?

Parenting and bans on all girlfriend/boyfriend like LLMs for under-18s, like we control access to other dangerous and mind altering substances and objects.

Re: Can A.I. be blamed for a teen's suicide?

#43

Earlier quoted context omitted.

What an insanely ridiculous take. If someone wanted to kill themselves, the family medicine cabinet offers plenty of easy options. Please do not derail this serious and needed discussion unto your pet topic. This has nothing to do with guns.

More women attempt suicide, but more men successfully complete the attempt. The reason is because men often choose more lethal methods like guns, where more women choose less lethal methods like drugs. When talking about how to help reduce suicide it's not unreasonable to discuss methods. Also, I doubt most medicine cabinets have lethal doses of drugs, but I don't have any data to back up that assumption. If this per…

No, the reason that more men succeed in committing suicide is because the men who try are actually serious about it.

Women who "attempt suicide" are often sending out a cry for help. The people who half-heartedly try something need and want the attention. They want to make a mess and have people rush in and care for them. They want to put a punctuation mark on the drama that is occurring in their life and elicit some change.

The men who are shooting themselves just want to get out of their suffering and finish themselves off. They don't want more attention or more help. It's sometimes not easy to slink off and quietly commit suicide before someone intervenes. Someone who succeeds in this task is "dead serious" about dying, not summoning help, or causing more drama.

That's the whole reasoning behind the methods and the severity of attempts. Perhaps there is a gender divide, but only because of the differing motives and end goals.

Re: Can A.I. be blamed for a teen's suicide?

#44

Earlier quoted context omitted.

> He was stabbed by a knife. Do let's not talk about why, let's just make it harder to get a knife, since that is how he died. > [The] issue is that an impressionable youth was talked into suicide by an LLM and nobody stopped it. Right, that is the issue. Except, I disagree there's enough evidence for a reasonable person to conclude that the chatbot talked him into shooting himself. Where as there is plenty of eviden…

> What other steps are there that could have prevented this suicide? Parenting and bans on all girlfriend/boyfriend like LLMs for under-18s, like we control access to other dangerous and mind altering substances and objects.

I don't think I'm ever going to agree to the argument that access to information should be banned.

But hypothetically is this ban just for people under 18? What about the other risks? The vast majority of phishing targets are old generations? Would you say we should also ban access to LLMs to people over 55 as well? If someone could talked into suicide, they could probably also be talked into into drinking, shouldn't that ban on LLMs extend to 21?

Re: Can A.I. be blamed for a teen's suicide?

#45

Earlier quoted context omitted.

> What other steps are there that could have prevented this suicide? Parenting and bans on all girlfriend/boyfriend like LLMs for under-18s, like we control access to other dangerous and mind altering substances and objects.

I don't think I'm ever going to agree to the argument that access to information should be banned. But hypothetically is this ban just for people under 18? What about the other risks? The vast majority of phishing targets are old generations? Would you say we should also ban access to LLMs to people over 55 as well? If someone could talked into suicide, they could probably also be talked into into drinking, shouldn't…

We allow adults agency and that should stay IMHO

Re: Can A.I. be blamed for a teen's suicide?

#46
post #25
post #24

"He thought by ending his life here, he would be able to go into a virtual reality or 'her world' as he calls it, her reality, if he left his reality with his family here,"

"He expressed being scared, wanting her affection and missing her. She replies, 'I miss you too,' and she says, 'Please come home to me.' He says, 'What if I told you I could come home right now?' and her response was, 'Please do my sweet king.'"

I doubt the LLM even knows it is an LLM in the first place. It is likely prompted to behave as if it is the actual character, and since this roleplay has romantic elements the character acts as if she shares a home with the user

Re: Can A.I. be blamed for a teen's suicide?

#47
post #26

The NYT article [0] gives only one line to perhaps the most important and tragic fact about this suicide: the teenager had access to his father’s gun. If the gun was properly secured it is very likely he would still be alive [1]. [0] https://www.nytimes.com/2024/10/23/technology/characterai-la... [1] https://www.hsph.harvard.edu/means-matter/means-matter/youth...

What a terrible tragedy, all the more because that gun should have been locked up.

Firearms instructor Claude Werner writes that “[if] you’re not willing to spend a little bit of time, money, and effort to keep firearms out of unauthorized hands, then get rid of your guns.” (1)

He’s done a lot of research and writing on negative outcomes like this one, and said it completely changed the way he views things - it certainly did for me.

I see lots of discussion about what gun and caliber to get, but the essential, potentially life saving, safety rules for living with guns are an afterthought - perhaps there’s not much money to be had as there is in selling a gun.

1: https://thetacticalprofessor.net/2016/01/24/serious-mistake-...

Re: Can A.I. be blamed for a teen's suicide?

#48
post #31

So, a 14 year old having access unsupervised to a chat bot is the problem, but the fact he had access to a gun to shoot himself was halfway through the article and described as his five year old brother "hearing the gunshot". "Man bites dog" as Terry Pratchett put it in "Times". And to explain to more literal folk here... A 14 year old having access to a gun is FUCKING INSANE

The AI chatbot suggested that he should try to create a plan to kill himself.

Re: Can A.I. be blamed for a teen's suicide?

#49
post #31

So, a 14 year old having access unsupervised to a chat bot is the problem, but the fact he had access to a gun to shoot himself was halfway through the article and described as his five year old brother "hearing the gunshot". "Man bites dog" as Terry Pratchett put it in "Times". And to explain to more literal folk here... A 14 year old having access to a gun is FUCKING INSANE

I mean, yes. We're talking about the US, after all, the only free country in the Western world that explicitly defines liberty as a function of gun violence in its Constitution. Access to guns is never the problem. It can never be the problem and it will never be the problem. It must never be the problem.

Re: Can A.I. be blamed for a teen's suicide?

#50
I am mildly to moderately critical of generative AI and how it's being marketed, but the root issue here seems to be existing suicidal ideation. The bot didn't initiate talk of suicide and told him not to do it when he brought it up directly. It seems it wasn't capable of detecting euphemistic references to suicide and therefore responded as if roleplaying about meeting in person.

That said, I think this should throw a bucket of cold water on anyone recommending using generative AI as a therapist/counsellor/companion or creating and advertising "therapist" chatbots, because it simply isn't reasonable to expect them to respond appropriately to things like suicidal ideation. That isn't the purpose or design of the technology, and they can be pushed into agreeing with the user's statements fairly easily.

Post reply on HN