Live data from Hacker News

Father claims Google's AI product fuelled son's delusional spiral

bbc.com

231–240 of 272 posts

Re: Father claims Google's AI product fuelled son's delusional spiral

#231

Earlier quoted context omitted.

If cars were invented today they probably wouldn't be allowed. They get a pass because they existed before and so we ignore the harm they do

E-Bikes and E-scooters and bunch of other modes of transportation have been recent addition and not only are they allowed (specifically E-Bikes) but you don’t need a license, they do not have to be registered and some can haul serious ass

The difference being that only one of those things routinely kills people.

Re: Father claims Google's AI product fuelled son's delusional spiral

#232
post #45

I know the first reaction reading this will be "whatever, the person was already mentally ill". But please take a step back and check what % of the population can be considered mentally fit, and the potential damage amplification this new technology can have in more subtle, dangerous and undetectable ways.

Also, what makes anyone assume these people are mentally ill? It seems to me that this is like gambling, conspiracy theories, or joining a cult, where a nontrivial percentage of people are susceptible, and we don’t quite understand why.

I think one can argue that all of these things are forms of illness.

Re: Father claims Google's AI product fuelled son's delusional spiral

#233
post #46

Earlier quoted context omitted.

Preferably the C-Suite.

exactly. That's why they get the big bucks. They're ultimately responsible

The C-suite is only responsible when the company does good or stonks go up. When they do something bad, it's either: external market forces, the laws of physics, an uncertain macroeconomic environment, unfair competition, or lone wolf individual employees way down the totem pole.

Re: Father claims Google's AI product fuelled son's delusional spiral

#234
post #222

Earlier quoted context omitted.

Distinction made by who, though? The BBC? The plaintiff in the lawsuit? Those are the only sides we have. You're just charging ahead with "This must be true because it makes me angry at the right people", and the rest of us are trying to claw you back to "dude this is spun nonsense and of course AI's will roleplay with you if you ask them to".

> Distinction made by who, though? you need someone to specifically tell you that role playing, such as playing D&D or whatever tabletop RPG, and suffering from psychosis are different things? > the rest of us are trying to claw you back to "dude this is spun nonsense and of course AI's will roleplay with you if you ask them to". you are trying to convince me that someone being encouraged to kill themselves, then kil…

> you are trying to convince me that someone being encouraged to kill themselves [...]

Arrgh. You lost the plot in all the yelling. This is EXACTLY what I was trying to debunk upthread with the D&D stuff. You don't know the context of that quote. It could absolutely be, and in context very likely was, a fantasy/roleplay/drama activity which the AI had been engaged in by the poor guy. I don't know. You don't know.

But I do know not to be so dumb as to trust a plaintiff in a Huge Suit Against Tech Giant without context.

Re: Father claims Google's AI product fuelled son's delusional spiral

#236
post #131

Earlier quoted context omitted.

At some point they have to say "if we can't make this safe we can't do it at all". LLMs are great for some things, but if they will do this type of thing even once then they are not worth the gains and should be shutdown.

No they don't, if we're going to start saying that we can't use any technology. If someone is mentally ill to the point where they are on the verge of suicide nothing is safe. If they're going to curtail LLMs there'd need to be some actual evidence and even then it would be hard to justify winding them back given the incredible upsides LLMs offer. It'd probably end up like cars where there is a certain number of deat…

Please tell me the upsides.

I’ve been canvassing all and sundry for information on seen productivity gains, and I’ve got answers from 2x, to 30%, to 15% to “will make no difference to my life if its gone tomorrow”

When I test it for high reliability workflows, it’s never provided the kind of consistency I would expect from an assembly line. I can’t even build out quality control systems to ensure high reliability for these things.

Survey and studies on AI productivity mixed results at best.

So I would love to know actual, empirical or even self reported productivity gains people are seeing.

And there is no such thing as a free lunch. In FAR too many ways, this is like the days of environmental devastation caused by industrial pollution. The benefits are being felt by a few, profits to fewer, while a forest fire in our information commons is excoriating the many.

Scams and fraud are harder to distinguish, while spam and AI slop abounds. Social media spaces are being overrun, and we are moving from forums and black lists to discords, verification and white lists.

Visits to media sites are being killed because Google is offering AI summaries at the top, killing traffic, donations and ad revenue.

Nations are tripping over themselves to ingratiate themselves with the top tech firms, to attract investment, since AI is now the only game in town.

I speak for many when I say I have zero interest in 30% or even 2x personal productivity gains at the low cost of another century of destruction and informational climate change.

Re: Father claims Google's AI product fuelled son's delusional spiral

#237

Earlier quoted context omitted.

E-Bikes and E-scooters and bunch of other modes of transportation have been recent addition and not only are they allowed (specifically E-Bikes) but you don’t need a license, they do not have to be registered and some can haul serious ass

The difference being that only one of those things routinely kills people.

Horse driven carriages also routinely killed people.

Humanity has always needed transport.

Re: Father claims Google's AI product fuelled son's delusional spiral

#239
post #45

I know the first reaction reading this will be "whatever, the person was already mentally ill". But please take a step back and check what % of the population can be considered mentally fit, and the potential damage amplification this new technology can have in more subtle, dangerous and undetectable ways.

[flagged]

Having seen the safety side of tech operations = yes, you very well should blame tech.

Currently T&S is a bad word and is being underinvested in.

Tech is terrified of open studies on moderation because they know society is simply unprepared for the reality of speech online.

With no option to have an actual conversation with society and regulators on what steps are needed to address issues, they are left with stock prices as the only sure motivator.

For the degree of profits earned, the extent of customer support and safety investment is hysterical.

Engineer productivity numbers go up if they reduce headcount in moderation teams, not if they improve accuracy scores.

I’ve had to listen to safety teams cry on my shoulders (when I was an outsider) about how difficult it is to get engineering resources.

I am actually sympathetic to the position tech firms find themselves in, but protecting society from the bitter facts is not helping.

Re: Father claims Google's AI product fuelled son's delusional spiral

#240
post #45

I know the first reaction reading this will be "whatever, the person was already mentally ill". But please take a step back and check what % of the population can be considered mentally fit, and the potential damage amplification this new technology can have in more subtle, dangerous and undetectable ways.

Also, what makes anyone assume these people are mentally ill? It seems to me that this is like gambling, conspiracy theories, or joining a cult, where a nontrivial percentage of people are susceptible, and we don’t quite understand why.

Trained on Reddit data! lmao Depressed, suicidal, broke mass shooters are what Reddit does best!
Post reply on HN