Live data from Hacker News

In Search of AI Psychosis

astralcodexten.com

201–210 of 258 posts

Re: In Search of AI Psychosis

#201

Earlier quoted context omitted.

Neurology has not proven any such thing. Our knowledge of neuroscience on the cognitive level is super limited and we don't have a good understanding about how any higher-order cognition works.

Neurobiology has proved this, just read Buzsaki or Northoff. The brain doesn't need models, it needs differences.

I have a PhD in cognitive science and my supervisor was a neuroscientist.

Re: In Search of AI Psychosis

#202
post #190

Earlier quoted context omitted.

Well yeah, that's a false dichotomy. If you're vulnerable and a chatbot sends you into a spiral of psychosis, your pre-existing vulnerability doesn't negate the fact that a harm has been done to you. If you have a heart condition, and I shoot you with a Taser, and it kills you… I've killed you. You weren't "already dead" just because you were vulnerable.

Yes but "what is the effect of tasers on hearts" is an interesting question when tasers are brand new. If it kills people with obvious pre-existing risks then that is not very surprising. If it kills 50% of otherwise healthy people in a way we didn't anticipate, that is alarming and important to distinguish. Imagine someone does a quick survey to estimate that tasers aren't killing people we don't expect, and some re…

> Imagine someone does a quick survey to estimate that tasers aren't killing people we don't expect

Given that the quote you cited was, "Are the chatbots really driving people crazy, or just catching the attention of people who were crazy already," I'd say the equivalent would be something like, "Are tasers really killing people, or were tasered heart attack victims dying already?"

And yeah, I'd be mad about that framing! The fact that the people who die had a preexisting vulnerability does not mean they were "already dying" or that they were not "really killed."

Re: In Search of AI Psychosis

#203
post #4

I have encountered this twice amongst people I know. I also feel that pre-AI this was already happening to people with social media - still kind of computer related as the bubble created is automated but the so called 'algorithms'

It is pretty bad to have a thing that can give you dopamine 24/7. Both social media with the algorithms, but also AI. Humans need sleep to function normally.

It would help if algorithms were optimised for sleep. Freezing your feed, making content more boring, nudging you to put your phone down. Same with AI, if they know you need to wake up the next day at a certain time, change the responses that add reminders to go to sleep.

Re: In Search of AI Psychosis

#204

Earlier quoted context omitted.

The problem is, neurobiology proves there are no world models. Silicon Valley bet on the wrong cognition model, a psychological version trapped in 20th C bunk, and everyone pays the price listening to cult leaders like Scott Alexander worm their way out of consciousness. https://pmc.ncbi.nlm.nih.gov/articles/PMC7415918/

It takes a pretty damn complicated model of the world to start explaining things with neurobiology.

Doesn't require models in dynamics, coordination or otherwise.

Re: In Search of AI Psychosis

#205

Earlier quoted context omitted.

No what you're describing is arbitrary and idiosyncratic. The brain doesn't use that to survive, it doesn't need them. Anything external to that is completely separate from thought. What you're describing is an arbitrary game for entertainment to fill up your time and confuse yourself and others. It has no relationship to the choices you would make to survive, and can only interfere with it. The "world model" you're…

I don’t necessarily disagree with you, but I wonder if you are not being overly reductive / pedantic. What is there then? What words (heh) do you use to distinguish between someone who makes more accurate predictions about the world than someone else?

First off, we don't use predictions, that's another model, it's false (Spontaneous Brain Northoff or read Mofakham's papers).

In terms of words, they barely represent and never reference. Any statement like that serves primarily status gain, not know knowledge transmission (I proved this from the first statement above as well).

The reality is CS built a math model from totally false premises as it relates to communication and knowledge. It works for efficient value trading using symbols in place of actions. Does it have a future, no.

The problem is how do we shift to a real neurodynamic system of sharing?

https://docs.google.com/document/d/1cXtU97SCjxaHCrf8UVeQGYaj...

Re: In Search of AI Psychosis

#206

> First, much like LLMs, lots of people don’t really have world models. This is interesting and something I never considered in a broad sense. I have noticed how the majority of programmers I worked with do not have a mental model of the code or what it describes – it's basically vibing without an LLM, the result accidental. This is fine and perfectly workable. You need only a fraction of devs to purposefully shape t…

It's fucking bonkers that people really claim that "lots of people" don't have World models. Can't say I'm surprised to hear this from rationalists like Alexander Scott who are too high on their own farts

Re: In Search of AI Psychosis

#207

Earlier quoted context omitted.

Neurobiology has proved this, just read Buzsaki or Northoff. The brain doesn't need models, it needs differences.

I have a PhD in cognitive science and my supervisor was a neuroscientist.

That's irrelevant. Cog-sci is largely folk psychology, and the problems in automating inference in AI demonstrate the model would eventually collapse. Question is how do we toss this model aside for an irreducible form of post-symbolic relationship between brains and machines?

Re: In Search of AI Psychosis

#208
post #33
post #24

Earlier quoted context omitted.

That's just a blatant misunderstanding of what diagnostic criteria are. They don't Actually ("ontologically") exist, they're Virtual constructs made for a purpose. In particular, over half a century of personality research had supported the concept of personality “traits” or dimensions, rather than “disorders” or categories. That is antithetical to the basic idea of a diagnosis. "You seem like an angry person" is not…

I mean the first and foremost principle of the DSM is that if the patient is not reporting or experiencing a debilitating ability to live a functional life, and is otherwise happy with their own lived experience, then whatever symptoms they have aren't a problem. There's obviously a gulf of potential argument in that definition, but a unique form would be people who report hearing voices, but they're not hostile or a…

Well put, very true! I think (?) the technical term is “distress”. This is also their out for not getting rid of “transvestic disorder” yet, which they swear is totally unrelated to trans people, it’s just for men who feel compelled to wear dresses and are sad about it…

Re: In Search of AI Psychosis

#209

Earlier quoted context omitted.

I have a PhD in cognitive science and my supervisor was a neuroscientist.

That's irrelevant. Cog-sci is largely folk psychology, and the problems in automating inference in AI demonstrate the model would eventually collapse. Question is how do we toss this model aside for an irreducible form of post-symbolic relationship between brains and machines?

I appreciate your gumption but I really think that you don't understand things as well as you think you do. Maybe read someone other than Paul Churchland.

Re: In Search of AI Psychosis

#210

Earlier quoted context omitted.

That's irrelevant. Cog-sci is largely folk psychology, and the problems in automating inference in AI demonstrate the model would eventually collapse. Question is how do we toss this model aside for an irreducible form of post-symbolic relationship between brains and machines?

I appreciate your gumption but I really think that you don't understand things as well as you think you do. Maybe read someone other than Paul Churchland.

Both Churchland's are out of date. Note the references above, this is a neurobiological, dynamic approach they're not party to. If you don't know what those are or optic flow, neural reuse are, then study them. Trad Neuroscience and cog-sci is no longer applicable.
Post reply on HN