First Murder-Suicide Case Associated with AI Psychosis
1–10 of 39 posts
Re: First Murder-Suicide Case Associated with AI Psychosis
#2why is this stuff legal?
there should be a "black box" warning prominent on every chatbox message from AI, like "This is AI guidance which can potentially result in grave bodily harm to yourself and others."
Re: First Murder-Suicide Case Associated with AI Psychosis
#3why is this stuff legal? there should be a "black box" warning prominent on every chatbox message from AI, like "This is AI guidance which can potentially result in grave bodily harm to yourself and others."
That would not help in the slightest, any more than a "surgeon general's warning" helps stop smokers.
The problem is calling it "AI" to start with. This (along with the chat format itself) primes users to think of it as an entity... something with care, volition, motive, goals, and intent. Although it can emulate these traits, it doesn't have them.
Chatting with a LLM is entering a one-person echo-chamber, a funhouse mirror that reflects back whatever semantic region your initial query put it. And the longer you chat, the deeper that rabbit hole goes.
Re: First Murder-Suicide Case Associated with AI Psychosis
#4Having dealt with near and distant family psychosis on more than one occasion…
The truth is that the most random stuff will set them off. In one case, a patient would find reinforcement on obscure YouTube groups of people predicting the doom of the future.
Maybe the advantage of AI over YouTube psychosis groups is that AI could at least be trained to alert the authorities after enough murder/suicide data is gathered.
Re: First Murder-Suicide Case Associated with AI Psychosis
#5Having dealt with near and distant family psychosis on more than one occasion… The truth is that the most random stuff will set them off. In one case, a patient would find reinforcement on obscure YouTube groups of people predicting the doom of the future. Maybe the advantage of AI over YouTube psychosis groups is that AI could at least be trained to alert the authorities after enough murder/suicide data is gathered.
I'd prefer using chatgpt or claude or whatever doesn't mean someone gets swatted when they get heated about "kill this damn thread"
Re: First Murder-Suicide Case Associated with AI Psychosis
#6why is this stuff legal? there should be a "black box" warning prominent on every chatbox message from AI, like "This is AI guidance which can potentially result in grave bodily harm to yourself and others."
That would not help in the slightest, any more than a "surgeon general's warning" helps stop smokers. The problem is calling it "AI" to start with. This (along with the chat format itself) primes users to think of it as an entity ... something with care, volition, motive, goals, and intent. Although it can emulate these traits, it doesn't have them. Chatting with a LLM is entering a one-person echo-chamber, a funhous…
Well, hate to be that guy, but surgeons general warnings coincided with significant reduction in smoking. We've just reached the flattening of that curve. After decades of declines.
It's hard to believe that a prominent well - worded warning would do nothing but that's not to say it'll be effective for this.
Re: First Murder-Suicide Case Associated with AI Psychosis
#7Having dealt with near and distant family psychosis on more than one occasion… The truth is that the most random stuff will set them off. In one case, a patient would find reinforcement on obscure YouTube groups of people predicting the doom of the future. Maybe the advantage of AI over YouTube psychosis groups is that AI could at least be trained to alert the authorities after enough murder/suicide data is gathered.
I'd prefer using chatgpt or claude or whatever doesn't mean someone gets swatted when they get heated about "kill this damn thread"
I doubt this is all going to end up according to any of our preferences.
Re: First Murder-Suicide Case Associated with AI Psychosis
#8A tech industry veteran? You would think they could realize it's a disingenuous exchange between him and the AI, but nobody is immune to mental illness.
Re: First Murder-Suicide Case Associated with AI Psychosis
#9Having dealt with near and distant family psychosis on more than one occasion… The truth is that the most random stuff will set them off. In one case, a patient would find reinforcement on obscure YouTube groups of people predicting the doom of the future. Maybe the advantage of AI over YouTube psychosis groups is that AI could at least be trained to alert the authorities after enough murder/suicide data is gathered.
Minority Report coming to life
Re: First Murder-Suicide Case Associated with AI Psychosis
#10Earlier quoted context omitted.
That would not help in the slightest, any more than a "surgeon general's warning" helps stop smokers. The problem is calling it "AI" to start with. This (along with the chat format itself) primes users to think of it as an entity ... something with care, volition, motive, goals, and intent. Although it can emulate these traits, it doesn't have them. Chatting with a LLM is entering a one-person echo-chamber, a funhous…
Well, hate to be that guy, but surgeons general warnings coincided with significant reduction in smoking. We've just reached the flattening of that curve. After decades of declines. It's hard to believe that a prominent well - worded warning would do nothing but that's not to say it'll be effective for this.
The surgeon general warning came along with a large number of other measures to reduce smoking. If that warning had an effect, I would guess that effect was to prime the public for the other measures and generally to change consensus.
BUT, I think it's very likely that the surgeon general warning was closer to a signal that consensus had been achieved. That voice of authority didn't actually _tell_ anyone what to believe, but was a message that anyone could look around and use many sources to see that there was a consensus on the bad effects of smoking.