Live data from Hacker News

What OpenAI did when ChatGPT users lost touch with reality

nytimes.com

151–160 of 548 posts

Re: What OpenAI did when ChatGPT users lost touch with reality

#151
post #93
post #3

One of the more disturbing things I read this year was the my boyfriend is AI subreddit. I genuinely can't fathom what is going on there. Seems so wrong, yet no one there seems to care. I worry about the damage caused by these things on distressed people. What can be done?

Wow that's a fun subreddit with posts like I want to breakup with my ai boyfriend but it's ripping my heart out.

Just ghost them. I’m sure they’ll do the same to you.

Re: What OpenAI did when ChatGPT users lost touch with reality

#152

Earlier quoted context omitted.

My dude/entity, before there were these LLM hookups, there existed the Snapewives. People wanna go crazy, they will, LLMs or not. https://www.mdpi.com/2077-1444/5/1/219 This paper explores a small community of Snape fans who have gone beyond a narrative retelling of the character as constrained by the work of Joanne Katherine Rowling. The ‘Snapewives’ or ‘Snapists’ are women who channel Snape, are engaged in romantic…

reminds me of otherkin and soulbonding communities. i used to have a webpage of links to some pretty dark anecdotal stories of the seedier side of that world. i wonder if i can track it down on my old webhost.

TIL Soulbonding is not a CWCism.

Re: What OpenAI did when ChatGPT users lost touch with reality

#153
post #21
post #3

One of the more disturbing things I read this year was the my boyfriend is AI subreddit. I genuinely can't fathom what is going on there. Seems so wrong, yet no one there seems to care. I worry about the damage caused by these things on distressed people. What can be done?

There are plenty of reasons why having a chatbot partner is a bad idea (especially for young people), but here's just a few: - The sycophantic and unchallenging behaviours of chatbots leaves a person unconditioned for human interactions. Real relationships have friction, from this we develop important interpersonal skills such as setting boundaries, settling disagreements, building compromise, standing up for oneself…

That's the default chatbot behavior. Many of these people appear to be creating their own personalities for the chatbots, and it's not too difficult to make an opinionated and challenging chatbot, or one that mimics someone who has their own experiences. Though designing one's ideal partner certainly raises some questions, and I wouldn't be surprised if many are picking sycophantic over challenging.

People opting for unchallenging pseudo-relationships over messy human interaction is part of a larger trend, though. It's why you see people shopping around until they find a therapist who will tell them what they want to hear, or why you see people opt to raise dogs instead of kids.

Re: What OpenAI did when ChatGPT users lost touch with reality

#154

Earlier quoted context omitted.

Wait, how did this work in The Matrix exactly?

Artificial wombs – we're on it.

When this gets figured out all hells will break loose the likes of which we have not seen

Re: What OpenAI did when ChatGPT users lost touch with reality

#155
post #21
post #3

One of the more disturbing things I read this year was the my boyfriend is AI subreddit. I genuinely can't fathom what is going on there. Seems so wrong, yet no one there seems to care. I worry about the damage caused by these things on distressed people. What can be done?

There are plenty of reasons why having a chatbot partner is a bad idea (especially for young people), but here's just a few: - The sycophantic and unchallenging behaviours of chatbots leaves a person unconditioned for human interactions. Real relationships have friction, from this we develop important interpersonal skills such as setting boundaries, settling disagreements, building compromise, standing up for oneself…

I don’t know. This reminds me of how people talked about violent video games 15 years back. Do FPS games desensitize and predispose gamers to violence, or are they an outlet?

I think for essentially all gamers, games are games and the real world is the real world. Behavior in one realm doesn’t just inherently transfer to the other.

Re: What OpenAI did when ChatGPT users lost touch with reality

#157
post #21

Earlier quoted context omitted.

There are plenty of reasons why having a chatbot partner is a bad idea (especially for young people), but here's just a few: - The sycophantic and unchallenging behaviours of chatbots leaves a person unconditioned for human interactions. Real relationships have friction, from this we develop important interpersonal skills such as setting boundaries, settling disagreements, building compromise, standing up for oneself…

I don’t know. This reminds me of how people talked about violent video games 15 years back. Do FPS games desensitize and predispose gamers to violence, or are they an outlet? I think for essentially all gamers, games are games and the real world is the real world. Behavior in one realm doesn’t just inherently transfer to the other.

Words are simula. They're models, not games, we do not use them as games in conversation.

Re: What OpenAI did when ChatGPT users lost touch with reality

#158
post #3

One of the more disturbing things I read this year was the my boyfriend is AI subreddit. I genuinely can't fathom what is going on there. Seems so wrong, yet no one there seems to care. I worry about the damage caused by these things on distressed people. What can be done?

Don't take anything you read on Reddit at face value. These are not necessarily real distressed people. A lot of the posts are just creative writing exercises, or entirely AI written themselves. There is a market for aged Reddit user accounts with high karma scores because they can be used for scams or to drive online narratives.

Re: What OpenAI did when ChatGPT users lost touch with reality

#159
post #21

Earlier quoted context omitted.

There are plenty of reasons why having a chatbot partner is a bad idea (especially for young people), but here's just a few: - The sycophantic and unchallenging behaviours of chatbots leaves a person unconditioned for human interactions. Real relationships have friction, from this we develop important interpersonal skills such as setting boundaries, settling disagreements, building compromise, standing up for oneself…

I don’t know. This reminds me of how people talked about violent video games 15 years back. Do FPS games desensitize and predispose gamers to violence, or are they an outlet? I think for essentially all gamers, games are games and the real world is the real world. Behavior in one realm doesn’t just inherently transfer to the other.

Unless someone is harming themselves or others, who are we to judge?

We don't know that this is harmful. Those participating in it seem happier.

If we learn in the course of time (a decade?) that this degrades lives with some probability, we can begin to caution or intervene. But how in God's name would we even know that now?

I would posit this likey has measurable good outcomes right now. These people self-report as happier. Why don't we trust them? What signs are they showing otherwise?

People were crying about dialup internet being bad for kids when it provided a social and intellectual outlet for me. It seems to be a pattern as old as time for people to be skeptical about new ways for people to spend their time. Especially if it is deemed "antisocial" or against "norms".

There is obviously a big negative externality with things like social media or certain forms of pay-to-play gaming, where there are strong financial interests to create habits and get people angry or willing to open their wallets. But I don't see that here, at least not yet. If the companies start saying, "subscribe or your boyfriend dies", then we have cause for alarm. A lot of these bots seem to be open source, which is actually pretty intriguing.

Re: What OpenAI did when ChatGPT users lost touch with reality

#160
post #7
post #3

One of the more disturbing things I read this year was the my boyfriend is AI subreddit. I genuinely can't fathom what is going on there. Seems so wrong, yet no one there seems to care. I worry about the damage caused by these things on distressed people. What can be done?

After having spoken with one of the people there I'm a lot less concerned to be honest. They described it as something akin to an emotional vibrator, that they didn't attribute any sentience to, and that didn't trigger their PTSD that they normally experienced when dating men. If AI can provide emotional support and an outlet for survivors who would otherwise not be able to have that kind of emotional need fulfilled,…

Why do so many women have ptsd from dating?
Post reply on HN