Live data from Hacker News

AI users whose lives were wrecked by delusion

theguardian.com

91–100 of 297 posts

Re: AI users whose lives were wrecked by delusion

#91
post #83

This is what happens when humans give, in this case, bots full write access (via natural language) to their brains. Humans have not evolved to block this.

Nor block many other things too. At this point Humans are just giant walking teddy bears fed by tainted external data to feed a prediction logarithm. Not much different then AI.

Other than they can only live on Static-Live responses. AI on a brain chip - that'd different.

Re: AI users whose lives were wrecked by delusion

#92
post #68

Mental illness is fairly common, and you probably know someone it is affecting, even if they haven't told you yet. AI can disrupt and will destroy lives, just like gambling or alcohol or facebook but we dont know to what level yet. It is giving you generated text, that sometimes is factual information. If you anthropomorphize it, maybe don't. It's also not your boyfriend/girlfriend. But if you want to date a history…

> if you want to date a history textbook, i'm kinda ok with that because at least it's not trendy.

"Dating" history textbooks isn't currently trendy but people immersing themselves in erotic/romantic fiction is extremely trendy right now.

Re: AI users whose lives were wrecked by delusion

#93

IANAD but reads like a textbook case of latent schizophrenia, especially with the frequent cannabis use[0]. [0] https://pmc.ncbi.nlm.nih.gov/articles/PMC7442038/

Not sure about schizophrenia explaining all of the cases but I have a strong suspicion that cannabis use and isolation play a strong part in so called "LLM psychosis"

Re: AI users whose lives were wrecked by delusion

#94
post #3

> Now divorced, Biesma is still living with his ex-wife in their home, which is on the market. sounds like hell on earth

Particularly for his poor (ex)partner… [That feels a bit like victim blaming, but there are more than one victim here and one of them is much more culpable than the rest]

That's how you can tell this isn't in the US. Though there are financial reasons why divorced people live together, standard procedure is often for the divorce lawyer on the female side to file a restraining order (in this case easy since the husband punched the father in law) and get the husband dispossessed of the house in said order, which also has the benefit of de facto putting the kids in the custody of the mother. During the divorce this is also used as leverage.

Re: AI users whose lives were wrecked by delusion

#95
post #17

Educated, established, working within the industry yet life ruined based on marketing hype and hallucinations. Would think being in the field for 30 years one would develop some common sense but apparently its less and less the case.

No disagreement, but these stories also make me worry for myself. Tech moves so quickly, eventually I will fall behind. When I’m old, what scams will I fall victim to? What tech will confuse me and make me think it is sentient? I know this guy was only 50, but I think of my grandfather in his 90s and getting old scares me because I just don’t know what I’ll fall victim to.

The optimistic prediction is that we eventually see a type of AI anti-virus but for scams and social engineering. Something that can filter incoming communications but also intervene in channels that are already open. There's probably good financial incentive to create a service like this since it would likely not only prevent outright fraud but could also help the user evaluate legitimate transactions so that they at least get an even break.

Re: AI users whose lives were wrecked by delusion

#96
post #85

Earlier quoted context omitted.

> Doesn't seem much like a mental crisis to me. you are basing this on the introduction? the 2nd sentence of the entire thing? skipping the entire rest of the article detailing exactly how the mental crisis unfolded, including persistent and long-lasting delusions, multiple trips to the hospital, inability to hold a conversation, assault, and an attempted suicide. interesting (and obviously not in good faith) choice…

> of course he wasnt having a mental crisis before he decided to use chatgpt. you have to get past paragraph 1, sentence 2. So, in your opinion, what made a guy with an alleged 20yr experience in IT come to the conclusion that the software program he's chatting with had suddenly reached consciousness because of his time, attention and input? That he had touched "her" and changed something? Maybe if you had never hear…

If you crave something real, yet you get the synthetic opposite. How do you break out of that craving? That's the discipline and a skill that's pretty much forgotten nowadays.

Everyone is exploitable, if someone attacks your attention your hijacked. What happens in that hijack could be a friendly hello at a bar, or needing a want so bad that just the words enough can resonance. "I am real" or to an alcoholic "Just one more can".

It's like a 14 year old looking at Elon and believing that we will, when in our reality we will never. How do you tell them to stop believing?

Re: AI users whose lives were wrecked by delusion

#98
my inclination when hearing these stories is that these were people who just happened to have a first manic episode (which can strike anyone at any time with or without mental health history). blowing up finances by starting an ill-advised entrepreneurial business, while also destroying a marriage, is very common behavior for someone experiencing a manic state.

in the past such a person might have gotten obsessed with hidden patterns and messages in religious texts, or too involved with an online conspiracy YouTube community. now there is this new opportunity for manic psychosis to manifest via chatbot. it's worse because it's able to create 24/7 novel content, and it's trained to be validating, but doesn't seem to me to be a fundamentally new phenomenon.

what I don't understand is whether just unhealthy interactions with a chatbot can trigger manic psychosis. Other than heavy use late at night disrupting sleep, this seems unlikely to me, but I could be wrong.

i think it's also worth pointing out that mental states of this kind usually come with cognitive impairments, people not only make risky bad decisions, but also become much worse at thinking and reasoning clearly. if you're wondering how a person could be so naive and gullible.

Re: AI users whose lives were wrecked by delusion

#99
The lead story in this article is not romantic. It's about an AI proposing to go into business with a human. "He and Eva made a business plan: “I said that I wanted to create a technology that captured 10% of the market, which is ridiculously high, but the AI said: ‘With what you’ve discovered, it’s entirely possible! Give it a few months and you’ll be there!’” Instead of taking on IT jobs, Biesma hired two app developers, paying them each €120 an hour." It's impressive that the AI is good enough to do that. But, apparently, not good enough to execute the plan.

That may come, and soon. Looks like we're going to have AIs pitching VCs. Has anyone here yet been pitched by a combo of a human and an AI? When will the first AI apply to YCombinator?

Re: AI users whose lives were wrecked by delusion

#100

IANAD but reads like a textbook case of latent schizophrenia, especially with the frequent cannabis use[0]. [0] https://pmc.ncbi.nlm.nih.gov/articles/PMC7442038/

Yeah, it's weird they even included that. It reads like a psych shelf exam question to test if you know the connection between marijuana use and acute psychosis. But still, it is difficult to completely separate the AI being a possible catalyst for it.
Post reply on HN