Live data from Hacker News

OpenAI says over a million people talk to ChatGPT about suicide weekly

techcrunch.com

201–210 of 585 posts

Re: OpenAI says over a million people talk to ChatGPT about suicide weekly

#201

My first reaction is how do they know? Are these all people sharing their chats (willingly) with OpenAI, or is opting out of “helping improve the model” for privacy a farce?

Does OpenAI's terms prevent them from looking at chats at all? I assumed that if you don't "help improve the model", it just means that they won't feed your chats in as training data, not that they won't look at your chats for other purposes.

Re: OpenAI says over a million people talk to ChatGPT about suicide weekly

#202

Earlier quoted context omitted.

Some of those men could meet someone if they quit Tinder or whatever crap online platform they might be using for dating, and start meeting people in real life. Worked for me at least. There's simply less competition and more space for genuine social interaction.

> and start meeting people in real life Do you have real life hobbies or something? I don't understand how this is supposed to work. I only ever go outside for groceries or gym, etc.

Go to parties.... One of the 5 biggest party days is this Friday, and with it being on a Friday it will be more intense. A solid 3 nights of good parties. That's all you have to do, I do not understand how this is lost on people. Go to parties and have fun and meet people.

Re: OpenAI says over a million people talk to ChatGPT about suicide weekly

#203

HIPAA anybody? (1) they probably shouldn't even have that data (2) they shouldn't have it lying around in a way that it an be attributed to particular individuals (3) imagine that it leaks to the wrong party, it would make the hack of that Finnish institution look like child's play (4) if people try to engage it in such conversations the bot should immediately back out because it isn't qualified to have these convers…

Tangent but now I’m curious about the bot, is there a write-up anywhere? How did it work? If someone says “hi”, what did the bot respond and what did the human do? I’m picturing ELIZA with templates with blanks a human could fill in with relevant details when necessary.

Re: OpenAI says over a million people talk to ChatGPT about suicide weekly

#204

Earlier quoted context omitted.

They are collecting training data for ads & erotica.

It sounds like you’re feeling down. Why don’t you pop a couple Xanax(tm) and shop on Amazon for a while, that always makes you feel better. Would you like me to add some Xanax(tm) to your shopping cart to help you get started?

Honestly, ChatGPT reminding you to take your meds would be a huge positive for ADHD.

Re: OpenAI says over a million people talk to ChatGPT about suicide weekly

#205

Earlier quoted context omitted.

Some of those men could meet someone if they quit Tinder or whatever crap online platform they might be using for dating, and start meeting people in real life. Worked for me at least. There's simply less competition and more space for genuine social interaction.

> and start meeting people in real life Do you have real life hobbies or something? I don't understand how this is supposed to work. I only ever go outside for groceries or gym, etc.

Do you live in a city? Or do you live in a suburb?

Suburbs are great for families and stable relationships, but they are atomizing

Go to a local bar once a week. Volunteer for something. Get a hobby.

Re: OpenAI says over a million people talk to ChatGPT about suicide weekly

#207

HIPAA anybody? (1) they probably shouldn't even have that data (2) they shouldn't have it lying around in a way that it an be attributed to particular individuals (3) imagine that it leaks to the wrong party, it would make the hack of that Finnish institution look like child's play (4) if people try to engage it in such conversations the bot should immediately back out because it isn't qualified to have these convers…

> if people try to engage it in such conversations the bot should immediately back out because it isn't qualified to have these conversations

For a lot of people, especially in poorer regions, LLMs are a mental health lifeline. When someone is severely depressed they can lay in bed the whole day without doing anything. There is no impulse, as if you tried starting a car and nothing happens at all, so you can forget about taking it to the mechanic in the first place by yourself. Even in developed countries you can wait for a therapist appointment for months, and that assumes you navigated a dozen therapists that are often not organized in a centralized manner. You will get people killed like this, undoubtedly.

LLMs are far beyond the point of leading people into suicidal actions, on the other hand. At the very least they are useful to bridge the gap between suicidal thoughts appearing and actually getting to see a therapist

Re: OpenAI says over a million people talk to ChatGPT about suicide weekly

#208

HIPAA anybody? (1) they probably shouldn't even have that data (2) they shouldn't have it lying around in a way that it an be attributed to particular individuals (3) imagine that it leaks to the wrong party, it would make the hack of that Finnish institution look like child's play (4) if people try to engage it in such conversations the bot should immediately back out because it isn't qualified to have these convers…

> HIPAA anybody?

Maybe. Going on a tangent: in theory GMail has access to lots of similar information---just by having approximately everyone's emails. Does HIPAA apply to them? If not, why not?

> If you give people something that seems to be a listening ear they will unburden themselves on that ear regardless of the implementation details of the ear.

Cf. Eliza, or the Rogerian therapy it (crudely) mimics.

Re: OpenAI says over a million people talk to ChatGPT about suicide weekly

#209

HIPAA anybody? (1) they probably shouldn't even have that data (2) they shouldn't have it lying around in a way that it an be attributed to particular individuals (3) imagine that it leaks to the wrong party, it would make the hack of that Finnish institution look like child's play (4) if people try to engage it in such conversations the bot should immediately back out because it isn't qualified to have these convers…

> we shut down the project realizing that we were in no way qualified to handle human interaction at that level

Ah, when people had a spine and some sense of ethics, before everything dissolved in a late stage capitalism all is for profit ethos. Even yourself is a "brand" to be monetised, even your body is to be sold.

We deserve our upcoming demise.

Re: OpenAI says over a million people talk to ChatGPT about suicide weekly

#210

HIPAA anybody? (1) they probably shouldn't even have that data (2) they shouldn't have it lying around in a way that it an be attributed to particular individuals (3) imagine that it leaks to the wrong party, it would make the hack of that Finnish institution look like child's play (4) if people try to engage it in such conversations the bot should immediately back out because it isn't qualified to have these convers…

As others have stated HIPAA applies to healthcare organizations.

Obligating everyone to keep voluntarily disclosed health statements confidential would be silly.

If I told you that I have a medical condition, right here on HN -- would it make sense to obligate you and everyone else here keep it a secret?

Post reply on HN