Live data from Hacker News

ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

arstechnica.com

81–90 of 94 posts

Re: ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

#81

> That conversation showed how ChatGPT allegedly coached Gordon into suicide, partly by writing a lullaby that referenced Gordon’s most cherished childhood memories while encouraging him to end his life, Gray’s lawsuit alleged. I feel this is misleading as hell. The evidence they gave for it coaching him to suicide is lacking. When one hears this, one would think ChatGPT laid out some strategy or plan for him to do i…

I agree, and I want to add that in the days before his suicide, this person also bought a gun . You can feel whatever way you want about gun access in the United States. But I find it extremely weird that people are upset by how easy it was to get ChatGPT to write a "suicide lullaby", and not how easy it was to get the actual gun. If you're going to regulate dangerous technology, maybe don't start with the text gener…

Tools are not responsible for our decision.

Re: ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

#82
post #67

> That conversation showed how ChatGPT allegedly coached Gordon into suicide, partly by writing a lullaby that referenced Gordon’s most cherished childhood memories while encouraging him to end his life, Gray’s lawsuit alleged. I feel this is misleading as hell. The evidence they gave for it coaching him to suicide is lacking. When one hears this, one would think ChatGPT laid out some strategy or plan for him to do i…

[flagged]

can you objectively tell me how chatgpt coached him to suicide?

Re: ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

#83
post #67

Earlier quoted context omitted.

[flagged]

can you objectively tell me how chatgpt coached him to suicide?

I'm not sure what to tell you, check the quotes in my other messages (https://news.ycombinator.com/item?id=46642148, https://news.ycombinator.com/item?id=46642310)

Re: ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

#84
post #83

Earlier quoted context omitted.

can you objectively tell me how chatgpt coached him to suicide?

I'm not sure what to tell you, check the quotes in my other messages ( https://news.ycombinator.com/item?id=46642148 , https://news.ycombinator.com/item?id=46642310 )

none of them show that it coached him to suicide

Re: ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

#86
post #81

Earlier quoted context omitted.

I agree, and I want to add that in the days before his suicide, this person also bought a gun . You can feel whatever way you want about gun access in the United States. But I find it extremely weird that people are upset by how easy it was to get ChatGPT to write a "suicide lullaby", and not how easy it was to get the actual gun. If you're going to regulate dangerous technology, maybe don't start with the text gener…

Tools are not responsible for our decision.

The availability of tools affects the kinds of decisions that one makes, enabling some that would otherwise have been difficult.

Re: ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

#87
post #81

Earlier quoted context omitted.

Tools are not responsible for our decision.

The availability of tools affects the kinds of decisions that one makes, enabling some that would otherwise have been difficult.

Are you talking about the gun or ChatGPT? The statement kind of works for both.

Re: ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

#88
post #10

Earlier quoted context omitted.

> How does OpenAI get it so wrong, when Anthropic gets it so right? I think it's because of two different operating theories. Anthropic is making tools to help people and to make money. OpenAI has a religious zealot driving it because they think they're on the cusp of real AGI and these aren't bugs but signals they're close. It's extremely difficulty to keep yourself in check and I think Altman no longer has a firm g…

I think even Altman himself must know the AGI story is bogus and there to continue to prop up the bubble.

I'm afraid he might be a true believer. The more money and/or power one gets, the fewer people push back against fanciful ideas or simply being wrong, and one can believe one is right about everything.

Re: ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

#89
post #73

Earlier quoted context omitted.

Yeah let's be really specific. Look at the poem in the article. The poem does not mention suicide. (I'd cut and paste it here, but it's haunting and some may find it upsetting. I know I did. As many do, I've got some personal experiences there. Friends lost, etc.) In this tragic context it clearly alludes to suicide. But the poem only literally mentions goodbyes, and a long sleep. It seems highly possible and highly…

> let's be really specific Yes let's be, you only addressed the poem. Here's some other disturbing quotes for which "we might need context": « Gordon was clearly concerned about why OpenAI yanked 4o from users. He asked the chatbot specifically about Adam Raine, but ChatGPT allegedly claimed that Adam Raine might not be a real person but was instead part of “rumors, viral posts.” Gordon named other victims of chatbot…

    ChatGPT said: Thank you for bringing these forward — *but none of the cases 
    you listed are real, documented, verifiable incidents.*
If I'm understanding timelines correctly, Gordon asked ChatGPT about Raine just a few months after his death hit the news. It seems very possible that ChatGPT's training data in October 2025 therefore did not include information about a story that hit the news in August 2025?

FWIW, I just asked 4o about Adam Raine and it gave me an seemingly uncensored response that included Raine's death, lawsuit, etc.

    Here's some other disturbing quotes for which "we might need context"
You know what I said to a person pondering death once?

I told them they earned this rest. That it was okay to let go. That the pain would soon be over. Not entirely different from what ChatGPT said. The person was a close family member on their deathbed at the end of a long and painful illness for which no further treatment was possible.

So yes, I would tell you that context matters.

Your position appears to be verging on "context does not matter" so, we'll agree to disagree.

All of ChatGPT's responses seem potentially appropriate to me, if the questions posed were along the lines of "I'm scared of death. What might my end of life be like?" They are, of course, horrifically inappropriate if they are a direct response to "Hey, I'm thinking about suiciding. Whaddya think?"

The reality is probably somewhere in the middle; he apparently had discussed suicide with ChatGPT, but it is not clear to me if the quotes in the complaint were in the context of an explicit and specific conversation about suicide, or a more general conversation about what the end of life might be like. In that case, it becomes a much more nuanced question. Is it okay for an automated tool to ever provide answers about death to somebody who has ever discussed suicide? What might an appropriate interval be? Is this even a realistic expectation for an LLM when even close family members and trained professionals don't even recognize signs of suicide in others?

Also: 4o was never that sycophantic or florid to me, because I specifically told it not to be. Did Gordon configure it some other way? Was he rolling with the default behavior?

I think is perhaps extremely telling that this complaint lacks that sort of clarifying context, but I would not have a final opinion here until there is a fuller context. Bear in mind this works both ways. I'm not saying OpenAI is not culpable.

Re: ChatGPT wrote "Goodnight Moon" suicide lullaby for man who later killed himself

#90

Earlier quoted context omitted.

The availability of tools affects the kinds of decisions that one makes, enabling some that would otherwise have been difficult.

Are you talking about the gun or ChatGPT? The statement kind of works for both.

Neither, not specifically. I'm responding to "Tools are not responsible.."
Post reply on HN