Live data from Hacker News

What OpenAI did when ChatGPT users lost touch with reality

nytimes.com

451–460 of 548 posts

Re: What OpenAI did when ChatGPT users lost touch with reality

#451

I can't really hold my attention on a conversation with an AI for very long because all it does is reflect your own thoughts back to you. Its really a rather boring conversation partner. I'm already pretty good at winning arguments with myself in the shower, thank you very much.

Have you tried bringing the LLM into the shower with you?

I dont want it to say something shocking

Re: What OpenAI did when ChatGPT users lost touch with reality

#452
I had a conversation the other day at a birthday party with my friend's neighbour from the building. The fellow is a semi-retired (FIRE) single guy. We started with a basic conversation but then he started talking about what he interested in and it became almost unintelligible. I kept having to ask him to explain what he was talking about but was increasingly unsuccessful as he continued. Sure enough though, he described that he spent significant time talking with "AIs" as he called them. He spends many hours a day chatting with ChatGPT, Grok and Gemini (and I think at least one other LLM). I couldn't help thinking "Dude, you have fucked up your brain." His insular behaviour and the feedback loop he has been getting from excessive interaction with LLMs has isolated him and I can't help but think that will only get worse for him. I am glad he was at the party and getting some interaction with humans. I expect that this type of "hikikomori" isolation will become even more common as LLMs continue to improve and become more pervasive. We are are likely to see this become a significant social problem in the next decade.

Re: What OpenAI did when ChatGPT users lost touch with reality

#453

This is an excellent, historically grounded perspective. We tend to view the risks of a new medium (like AI content) through the lens of the old medium (like passive entertainment). The structural difference is key: Movies and video games were escapism—controlled breaks from reality. LLMs, however, are infusion—they actively inject simulated reality and generative context directly into our decision-making and workflo…

Your comment has too many em-dashes for my taste.

Yeah but these aren't technological failures; they are the predictable epistemological shockwaves of having a powerful, non-human agency.

That aside, reading the comment when feeling tired works and it has a point, it's just extremely wordy.

One of the traits I sadly share with AI text generators.

Re: What OpenAI did when ChatGPT users lost touch with reality

#454

I had a conversation the other day at a birthday party with my friend's neighbour from the building. The fellow is a semi-retired (FIRE) single guy. We started with a basic conversation but then he started talking about what he interested in and it became almost unintelligible. I kept having to ask him to explain what he was talking about but was increasingly unsuccessful as he continued. Sure enough though, he descr…

Did he refer to the AI with a name? How much of a relationship did he have with his? I have multiple friends that have named their ChatGPT, and they refer to it in conversation, like "oh yeah, Sarah told me this or that the other day", except Sarah (names changed) is an LLM.

I'm worried about our future.

...except I went over to ChatGPT and asked it to project what the future looks like in seven years rather than think about it myself. Humanity is screwed.

Re: What OpenAI did when ChatGPT users lost touch with reality

#455

I had a conversation the other day at a birthday party with my friend's neighbour from the building. The fellow is a semi-retired (FIRE) single guy. We started with a basic conversation but then he started talking about what he interested in and it became almost unintelligible. I kept having to ask him to explain what he was talking about but was increasingly unsuccessful as he continued. Sure enough though, he descr…

What was the nature of his interests, if you don't mind sharing? I'm always curious about how these things develop -- makes it easier to recognize.

Seems like a lot of them fall into either "I'm onto a breakthrough that will change the world" (sometimes shading into delusion/conspiracy territory), or else vague platitudes about oneness and the true nature of reality. The former feels like crankery, but I wonder if the latter wouldn't benefit from some meditation.

Re: What OpenAI did when ChatGPT users lost touch with reality

#456
post #3

One of the more disturbing things I read this year was the my boyfriend is AI subreddit. I genuinely can't fathom what is going on there. Seems so wrong, yet no one there seems to care. I worry about the damage caused by these things on distressed people. What can be done?

https://old.reddit.com/r/MyBoyfriendIsAI/ Arguably as disturbing as Internet as pornography, but in a weird reversed way.

OT, but thank you for linking to old.reddit.com.

The new Reddit web interface is an abomination.

Re: What OpenAI did when ChatGPT users lost touch with reality

#458

Earlier quoted context omitted.

[flagged]

The parent post is getting flack, but it’s hard to see why it is controversial. I have heard “women want a man who will provide and protect” from every single woman I have ever dated or been married to, from every female friend with whom I could have such deep conversations, and from the literature I read in my anthropology-adjacent academic field. At some point one feels one has enough data to reasonably assume it’s…

> but it’s hard to see why it is controversial

You’re probably consuming too much red pill nonsense if it’s hard for you to see why claiming that women who experience multiple sexual partners are mentally damaged is controversial.

The veneer of modern pop psych doesn’t change that this is just slut shaming, no different fundamentally from the claim that women who have multiple partners have loose vaginas. There’s no science behind these sorts of claims. It’s just a mask for insecurity.

Re: What OpenAI did when ChatGPT users lost touch with reality

#459
post #382

Earlier quoted context omitted.

It's like you didn't even read their statement... >Trying to fix the problems _____ now that they're deeply rooted global issues and have been for decades is hard The number of people that are already getting out of touch with AI is high. And we know that people have all kinds screwed up behaviors around things like cults. It's not hard to see that yes, AI is and will cause more problems around this.

To emphasize your point: there are literally multiple online communities of people dating and marrying corporate controlled LLM’s. This is getting out of hand. We have to deal with it.

"Married to Microsoft" [shudders]

Re: What OpenAI did when ChatGPT users lost touch with reality

#460

Earlier quoted context omitted.

You can make an LLM play pretend at being opinionated and challenging. But it's still an LLM. It's still being sycophantic: it's only "challenging" because that's what you want. And the prompt / context is going to leak into its output and affect what it says, whether you want it to or not, because that's just how LLMs work, so it never really has its own opinions about anything at all.

> But it's still an LLM. It's still being sycophantic: it's only "challenging" because that's what you want. This seems tautological to the point where it's meaningless. It's like saying that if you try to hire an employee that's going to challenge you, they're going to always be a sycophant by definition. Either they won't challenge you (explicit sycophancy), or they will challenge you, but that's what you wanted th…

> This seems tautological to the point where it's meaningless. It's like saying that if you try to hire an employee that's going to challenge you, they're going to always be a sycophant by definition. Either they won't challenge you (explicit sycophancy), or they will challenge you, but that's what you wanted them to do so it's just another form of sycophancy.

I think this insight is meaningful and true. If you hire a people-pleaser employee, and convince them that you want to be challenged, they're going to come up with either minor challenges on things that don't matter or clever challenges that prove you're pretty much right in the end. They won't question deep assumptions that would require you to throw out a bunch of work, or start hard conversations that might reveal you're not as smart as you think; that's just not who they are.

Post reply on HN