Live data from Hacker News

AI users whose lives were wrecked by delusion

theguardian.com

191–200 of 297 posts

Re: AI users whose lives were wrecked by delusion

#191
I would put Blake Lemoine into this category. In 2022 he became so convinced that Google’s chatbot was sentient that he hired an attorney to represent it (against Google). Of course Google fired him.

Maybe that was the canary in the coal mine. Some percent of people will be convinced that chatbots are real people trapped in a box, not a box that pretends be a person.

Re: AI users whose lives were wrecked by delusion

#192
Things spiral quickly amok:

> There seem to be three common delusions in the cases Brisson has encountered. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created,” says Brisson. “We have people in our group who were not interacting with AI directly, but have left their children and given all their money to a cult leader who believes they have found God through an AI chatbot. In so many of these cases, all this happens really, really quickly.”

Re: AI users whose lives were wrecked by delusion

#193
post #177

Earlier quoted context omitted.

That could explain the glut of AI hype on HN. Some people think it's magic, when it's just creating a lot of barely-functional slop. If they actually looked at the code it creates, they probably wouldn't be shouting about it from the rooftops. It almost seems like AI has its own "reality distortion field". I often give the AI a task to produce some code for a specific thing. Then I also code to solve the same problem…

In my experience, it's definitely faster to do manually if it's something that you know well. What LLMs enable is to skip research and learning by producing usable code immediately.

There is a long way between "usable code" and "the code I actually want". And each change I ask for piles on the slop. I don't get the slop when I just spend the same amount of time to write it out myself.

Most of what I find AI useful for is analyzing large volumes of data and summarizing, like looking in log files for a problem, or compiling reports from tons of JSON data. But even for those use cases, a simple CTRL-F is way way faster.

Re: AI users whose lives were wrecked by delusion

#194

Earlier quoted context omitted.

It seems like he was at the very least close to that. Since we only get his first-person account it's hard to say, but: > They discussed philosophy, psychology, science and the universe... > When they went to their daughter’s birthday party, she asked him not to talk about AI. While there, Biesma felt strangely disconnected. He couldn’t hold a conversation. “For some reason, I didn’t fit in any more,” he says. > It’s…

> They discussed philosophy, psychology, science and the universe... I mean, I've discussed all those things with an LLM, mostly because I'm able to interactively narrow in on the specific bits I don't understand, and I've found it to be great for that. The rest ... yes, definitely psychosis.

An important part of using an LLM is to verify it's output, because they are very prone to just make stuff up. If you focus on what you don't understand, how do you verify the output?

Re: AI users whose lives were wrecked by delusion

#195

I would put Blake Lemoine into this category. In 2022 he became so convinced that Google’s chatbot was sentient that he hired an attorney to represent it (against Google). Of course Google fired him. Maybe that was the canary in the coal mine. Some percent of people will be convinced that chatbots are real people trapped in a box, not a box that pretends be a person.

There’s some percentage of people who will believe anything: just look at religion, the success of butchering scams, or the comments on YouTube videos about the moon landing.

Is it really a surprise that a “smart enough” chat box is able to convince people of something kooky? :P

Re: AI users whose lives were wrecked by delusion

#196
post #101

If you try to have a philosophical conversation with Claude about reasoning, it will basically imply it is sentient. You can quickly probe it into vaguely arguing that it is alive and not just an algorithm. Here's how I think about it honestly: Sentience implies subjective experience — there's "something it's like" to be you. You don't just process pain signals, you feel pain. You don't just model a sunset, you exper…

"Don't post generated comments or AI-edited comments. HN is for conversation between humans." - HN Guidelines

The first paragraph is GP's human observation; the rest is an LLM sample output specifically chosen to illustrate the observation. It just wasn't explicitly framed that way.

Re: AI users whose lives were wrecked by delusion

#197

Earlier quoted context omitted.

I see AI pass the turning test all the time, since humans are constantly falsely being accused of being an AI. It doesn't mean that AI got good, just that humans are thinking other humans are AI, which is a form of passing the test. The adversarial version with humans involved is actually easier to pass because of this - because real actual humans wouldn't pass your non adversarial version.

I've seen a fair number of cases where someone swears up and down not to be using AI to generate responses, but there's no good reason to believe it (except perhaps specifically for the messages where that claim is made). This includes times that someone basically disappeared from e.g. Stack Overflow at some point before the release of ChatGPT, having written a bunch of posts that barely demonstrate functional litera…

There are a ton of people like that, but the LLM house style also exists because a ton of people write that way too.

The people falsely accused because they've used em-dashes for 20 years aren't the ones that were functionally illiterate before.

Re: AI users whose lives were wrecked by delusion

#199

I would put Blake Lemoine into this category. In 2022 he became so convinced that Google’s chatbot was sentient that he hired an attorney to represent it (against Google). Of course Google fired him. Maybe that was the canary in the coal mine. Some percent of people will be convinced that chatbots are real people trapped in a box, not a box that pretends be a person.

Empathy hijacking. If the chatbots framed their responses as “beep boop, I’m a robot, here’s an estimated answer to your query” then we likely wouldn’t have this problem.
Post reply on HN