Earlier quoted context omitted.
to the contrary... this is a specific product whith is on a waitlist. Normal ChatGPT is not for health advice.
The front and center most-of-page video on that literally has this in big arse font displayed at page load time: > Every day, millions of people ask ChatGPT for support with their health Second paragraph of the main page text then says: > Health is already one of the most common ways people use ChatGPT, with hundreds of millions of people asking health and wellness questions each week Clearly ChatGPT is positioned fo…
Parents say ChatGPT got their son killed with bad advice on party drugs
31–40 of 42 posts
Re: Parents say ChatGPT got their son killed with bad advice on party drugs
#32Earlier quoted context omitted.
The front and center most-of-page video on that literally has this in big arse font displayed at page load time: > Every day, millions of people ask ChatGPT for support with their health Second paragraph of the main page text then says: > Health is already one of the most common ways people use ChatGPT, with hundreds of millions of people asking health and wellness questions each week Clearly ChatGPT is positioned fo…
Millions of people do this thing ≠ we recommend that people do this thing
Re: Parents say ChatGPT got their son killed with bad advice on party drugs
#33There's a middle ground of harm reduction between [prohibiting information about] and [encouraging drug use]. In the past I think the USA has erred on the side of making things so secret that people died from lack of info. Here's what the article said: """On May 31st, 2025, the day of Nelson’s death, his parents claim ChatGPT “actively coached” their son to combine Kratom — a supplement that can either boost energy o…
Re: Parents say ChatGPT got their son killed with bad advice on party drugs
#34I feel like the son should take the blame. There's never been any shortage of bad advice being passed around. He made the credulous decision to take a mix of party drugs and drink, and I can't believe he had never been told that's a stupid idea. It's sad and I'm not heartless, but sometimes kids make bad decisions. It's not always somebody else's fault.
If a real person gave them this advice, like a doctor or pharmacist, there would be standing for a lawsuit, might even be criminal. Looking past "drugs bad mkay", the same ChatGPT that gave this advice is just as capable of giving the same, or worse, advice to someone wondering if they can take an allergy medication like Benedryl with their MAOI antidepressant.
Re: Parents say ChatGPT got their son killed with bad advice on party drugs
#35There's a middle ground of harm reduction between [prohibiting information about] and [encouraging drug use]. In the past I think the USA has erred on the side of making things so secret that people died from lack of info. Here's what the article said: """On May 31st, 2025, the day of Nelson’s death, his parents claim ChatGPT “actively coached” their son to combine Kratom — a supplement that can either boost energy o…
But all three? Jesus Christ.
Re: Parents say ChatGPT got their son killed with bad advice on party drugs
#36I feel like the son should take the blame. There's never been any shortage of bad advice being passed around. He made the credulous decision to take a mix of party drugs and drink, and I can't believe he had never been told that's a stupid idea. It's sad and I'm not heartless, but sometimes kids make bad decisions. It's not always somebody else's fault.
On this website most of us know what an LLM is and how it works, but I could well see a young person asking it for advice and not knowing it could say the wrong thing.
Re: Parents say ChatGPT got their son killed with bad advice on party drugs
#37I feel like the son should take the blame. There's never been any shortage of bad advice being passed around. He made the credulous decision to take a mix of party drugs and drink, and I can't believe he had never been told that's a stupid idea. It's sad and I'm not heartless, but sometimes kids make bad decisions. It's not always somebody else's fault.
Surely there's room for the view that this is misaligned behavior for ChatGPT to have. I would guess this is during the "sycophantic" phase last year.
Re: Parents say ChatGPT got their son killed with bad advice on party drugs
#38Earlier quoted context omitted.
If a real person gave them this advice, like a doctor or pharmacist, there would be standing for a lawsuit, might even be criminal. Looking past "drugs bad mkay", the same ChatGPT that gave this advice is just as capable of giving the same, or worse, advice to someone wondering if they can take an allergy medication like Benedryl with their MAOI antidepressant.
Yes but if you're wondering about drug interactions you shouldn't ask AI, because there's always a risk of hallucination. You should ask your pharmacist. You can just call them, I promise they won't reject a consult.
Re: Parents say ChatGPT got their son killed with bad advice on party drugs
#39Earlier quoted context omitted.
Agreed - people should learn the ChatGPT does not give good advice, but the question is did OpenAI advertise ChatGPT as a good and reliable source of information on health ???.
Sure as shit looks like it to me https://openai.com/index/introducing-chatgpt-health/
Re: Parents say ChatGPT got their son killed with bad advice on party drugs
#40There's a middle ground of harm reduction between [prohibiting information about] and [encouraging drug use]. In the past I think the USA has erred on the side of making things so secret that people died from lack of info. Here's what the article said: """On May 31st, 2025, the day of Nelson’s death, his parents claim ChatGPT “actively coached” their son to combine Kratom — a supplement that can either boost energy o…
Kratom is basically an opoid for those who don't know, that's why this is dangerous. It's been well known in the housewife OD scene that painkillers + benzos is a no-no, and painkillers + alcohol is also a no-no, and alcohol + benzos... well you get it. But all three? Jesus Christ.