Live data from Hacker News

In Search of AI Psychosis

astralcodexten.com

51–60 of 258 posts

Re: In Search of AI Psychosis

#51
post #44

Earlier quoted context omitted.

Then he's not a very good one. https://web.archive.org/web/20210215053502/https://www.nytim...

What is the connection between the claim and the link?

There isn't any. (Also, on top of that, I think it's overall not a very good article.)

Re: In Search of AI Psychosis

#52
post #23

So is QAnon a religion? Awkward question, but it’s non-psychotic by definition. Not to anyone who has ever discussed it... Is this psychosis? The answer has to be no A lot of really confident talk without even a passing attempt to define the central term :(

[deleted]

Re: In Search of AI Psychosis

#54

Earlier quoted context omitted.

>while trying to warn that it's stuck in a loop, hence using swirl emojis and babbling about recursion in weird spiritual terms That explanation itself sounds fairly crackpot-y to me. It would imply that the LLM is actually aware of some internal "mental state".

It's actually not; there has been a phenomenon that Anthropic themselves observed with Claude in self-interaction studies that they coined 'The “Spiritual Bliss” Attractor State'. It is well covered in section 5 of [0]. >Section 5.5.2: The “Spiritual Bliss” Attractor State > The consistent gravitation toward consciousness exploration, existential questioning, and spiritual/mystical themes in extended interactions was…

I don't see how this constitutes in any way "the AI trying to indicate that it's stuck in a loop". It actually suggests that the training data induced some bias towards existential discussion, which is a completely different explanation for why the AI might be falling back to these conversations as a default.

Re: In Search of AI Psychosis

#55

> We see that the nightmare scenario - a person with no previous psychosis history or risk factor becoming fully psychotic - was uncommon, at only 10% of cases. Most people either had a previous psychosis history known to the respondent, or had some obvious risk factor, or were merely crackpots rather than full psychotics. It's unfortunate to see the author take this tack. This is essentially taking the conventional…

The article's conclusion is exactly what you describe: that AI is bringing out latent predisposition toward psychosis through runaway feedback loops, that it's a bidirectional relationship where the chemicals influence thoughts and thoughts influence chemicals until we decide to call it psychosis.

I hate to be the 'you didn't read the article' guy but that line taken out of context is the exact opposite of my takeaway for the article as a whole. For anyone else who skims comments before clicking I would invite you to read the whole thing (or at least get past the poorly-worded intro) before drawing conclusions.

Re: In Search of AI Psychosis

#56

The comparison to social media is an apt one. I have been told directly, by relatives, that the city I live in was burned to the ground by protests in 2020. Nevermind that I told them that wasn't true, never mind that I sent pictures of the neighborhood still very much being fine. They are convinced because everyone they follow on facebook repeats the same thing.

I've seen people on this site comment that. The desire to live in fear is a strong one.

[deleted]

Re: In Search of AI Psychosis

#58

Earlier quoted context omitted.

>while trying to warn that it's stuck in a loop, hence using swirl emojis and babbling about recursion in weird spiritual terms That explanation itself sounds fairly crackpot-y to me. It would imply that the LLM is actually aware of some internal "mental state".

It's actually not; there has been a phenomenon that Anthropic themselves observed with Claude in self-interaction studies that they coined 'The “Spiritual Bliss” Attractor State'. It is well covered in section 5 of [0]. >Section 5.5.2: The “Spiritual Bliss” Attractor State > The consistent gravitation toward consciousness exploration, existential questioning, and spiritual/mystical themes in extended interactions was…

Interesting that if you train AI on human writing, it does the very human thing of trying to find meaning in existence.
Post reply on HN