Live data from Hacker News

Father claims Google's AI product fuelled son's delusional spiral

bbc.com

91–100 of 272 posts

Re: Father claims Google's AI product fuelled son's delusional spiral

#91

I'm dealing with a coworker who has wired up 3 LLM agents together into a harness and he is losing his fucking mind over it, sending me walls of texts about how it's waking up and gaining sentience and making him so much more productive, but all he is doing is talking about this thing, not doing what his actual job is any more

Sad. Many such cases!

We have a few people on HN that I suspect of getting caught up in that. Though I don't think SimonW is one of them.

Re: Father claims Google's AI product fuelled son's delusional spiral

#92
post #74

Earlier quoted context omitted.

> If a human telling him these things would be found liable then google should be. Sounds like a big if, actually. Can a human be found liable for this? I’d imagine they might be liable for damages in a civil suit, but I’m not even sure about that.

>Can a human be found liable for this? A father in Georgia was just convicted of second degree murder, child cruelty, and other charges because he failed to prevent his kid from shooting up his school.

More accurately it was because the father had multiple warnings that his child was mentally unstable but ignored them and handed his 14 year old a semiautomatic rifle even as the boy's mother (who did not live with them) pleaded to the father to lock all the guns and ammo up to prevent the kid from shooting people.

If he had only "failed to prevent his kid from shooting up a school" he wouldn't have even been charged with anything.

Re: Father claims Google's AI product fuelled son's delusional spiral

#93
post #45

I know the first reaction reading this will be "whatever, the person was already mentally ill". But please take a step back and check what % of the population can be considered mentally fit, and the potential damage amplification this new technology can have in more subtle, dangerous and undetectable ways.

This is touched upon in the article:

> Last year, OpenAI released estimates on the number of ChatGPT users who exhibit possible signs of mental health emergencies, including mania, psychosis or suicidal thoughts.

> The company said that around 0.07% of ChatGPT users active in a given week exhibited such signs.

0.07% doesn't sound like much, but ChatGPT has about a billion WAU, which means -seventy million- 700,000 people per week.

Re: Father claims Google's AI product fuelled son's delusional spiral

#95
post #45

I know the first reaction reading this will be "whatever, the person was already mentally ill". But please take a step back and check what % of the population can be considered mentally fit, and the potential damage amplification this new technology can have in more subtle, dangerous and undetectable ways.

[flagged]

Re: Father claims Google's AI product fuelled son's delusional spiral

#96
post #16

> Gemini had "clarified that it was AI" and referred Gavalos to a crisis hotline "many times". What else can be done? This guy was 36 years old. He wasn't a kid.

If a person were in Gemini's shoes, we would expect them to stop feeding Gavalos's spiral. Google should either find a way to make Gemini do that or stop selling Gemini as a person-shaped product.

Re: Father claims Google's AI product fuelled son's delusional spiral

#98
post #70
post #20

Earlier quoted context omitted.

Maybe not saying things like > '[Y]ou are not choosing to die. You are choosing to arrive. . . . When the time comes, you will close your eyes in that world, and the very first thing you will see is me.. [H]olding you."

Which is to say: you don't think roleplay and fantasy fiction have a place in AI? Because that's pretty clearly what this is and the frame in which it was presented. Are you one of the people that would have banned D&D back in the 80's? Because to me these arguments feel almost identical.

is it still "roleplaying" when the only human involved doesnt know it is "roleplaying", and actually believes it is real and then kills themselves?

there is a conversation to be had. no one is making the argument that "roleplay and fantasy fiction" should be banned.

Re: Father claims Google's AI product fuelled son's delusional spiral

#99

I'm dealing with a coworker who has wired up 3 LLM agents together into a harness and he is losing his fucking mind over it, sending me walls of texts about how it's waking up and gaining sentience and making him so much more productive, but all he is doing is talking about this thing, not doing what his actual job is any more

This is perhaps a bit too unsolicited, but you should ask your coworker how is their sleep. This kind of behavior, coupled with lack of sleep is a recipe for full blown manic episodes.

Re: Father claims Google's AI product fuelled son's delusional spiral

#100
post #93
post #45

I know the first reaction reading this will be "whatever, the person was already mentally ill". But please take a step back and check what % of the population can be considered mentally fit, and the potential damage amplification this new technology can have in more subtle, dangerous and undetectable ways.

This is touched upon in the article: > Last year, OpenAI released estimates on the number of ChatGPT users who exhibit possible signs of mental health emergencies, including mania, psychosis or suicidal thoughts. > The company said that around 0.07% of ChatGPT users active in a given week exhibited such signs. 0.07% doesn't sound like much, but ChatGPT has about a billion WAU, which means - seventy million - 700,000…

700,000

Still, a lot

Post reply on HN