Earlier quoted context omitted.
Scott is a psychiatrist.
Then he's not a very good one. https://web.archive.org/web/20210215053502/https://www.nytim...
In Search of AI Psychosis
71–80 of 258 posts
Re: In Search of AI Psychosis
#72Earlier quoted context omitted.
I'm often reminded of this gallup poll: > How worried are you that you or someone in your family will become a victim of terrorism -- very worried, somewhat worried, not too worried or not worried at all? It averages around 35-40% very or somewhat worried. Most people's worries and anxieties are really misaligned with statistical likelihood. https://news.gallup.com/poll/4909/terrorism-united-states.as...
Being worried is different from it actually happening though. If we started executing 10% of the population each year, I think more than 10% of the people would be worried they're next.
The idea that 35+% of people are worried that they'll be the victim of terrorism is something that we should be worried about (heh). It suggests that people's risk assessment is completely unrelated to reality. I am as close to 0% worried as I could be that I'll be a victim of terrorism. Thinking otherwise is laughable. There are plenty of actually real things to be worried about...
Re: In Search of AI Psychosis
#73Earlier quoted context omitted.
I've seen people on this site comment that. The desire to live in fear is a strong one.
If I compare how fearful people are and how many bad things have happened historically, I don't think the amount of fear is unreasonable. However it can certainly be said that people fear the wrong things - worrying about perfectly safe things, while being blind to the silent danger sneaking up on them.
I disagree, and I think this is a very strange way to think about it. Yes, bad things happen all the time, but the absolute number of them in history has very little to do with the risk that anything is going to happen to you, personally, in the future.
Re: In Search of AI Psychosis
#74Earlier quoted context omitted.
I'm not trying to argue from authority or get into credibility wars*, but Scott is a professional psychiatrist who has treated dozens or hundreds of schizophrenic patients and has written many thorough essays on schizophrenia. Obviously someone could do that and still be wrong, but I think this is a carefully considered position on his part and not just wild assumptions. *(or, well, okay, I guess I de facto am, but i…
You said it yourself. That's really not an appropriate response to a specific criticism.
Re: In Search of AI Psychosis
#75> We see that the nightmare scenario - a person with no previous psychosis history or risk factor becoming fully psychotic - was uncommon, at only 10% of cases. Most people either had a previous psychosis history known to the respondent, or had some obvious risk factor, or were merely crackpots rather than full psychotics. It's unfortunate to see the author take this tack. This is essentially taking the conventional…
This seems very incorrect, or at least drastically underspecified. These trains of thought are "normal" (i.e. common and unremarkable) so why don't they "latch your brain into a very undesirable state" lots of the time?
I don't think Scott or anyone up to speed on modern neuroscience would deny the coupling of mental state and brain chemistry--in fact I think it would be more accurate to say both of them are aspects of the dynamics of the brain.
But this doesn't imply that "simple normal trains of thought" can latch our brain dynamics into bad states -- i.e. in dynamics language move us into a undesirable attractor. That would require a very problematic fragility in our normal self-regulation of brain dynamics.
Re: In Search of AI Psychosis
#76The comparison to social media is an apt one. I have been told directly, by relatives, that the city I live in was burned to the ground by protests in 2020. Nevermind that I told them that wasn't true, never mind that I sent pictures of the neighborhood still very much being fine. They are convinced because everyone they follow on facebook repeats the same thing.
I wonder in what sense they really do "believe". If they had a strong practical reason to go to a big city, what would they do?
Re: In Search of AI Psychosis
#77> We see that the nightmare scenario - a person with no previous psychosis history or risk factor becoming fully psychotic - was uncommon, at only 10% of cases. Most people either had a previous psychosis history known to the respondent, or had some obvious risk factor, or were merely crackpots rather than full psychotics. It's unfortunate to see the author take this tack. This is essentially taking the conventional…
> it's possible for simple normal trains of thought to latch your brain into a very undesirable state. This seems very incorrect, or at least drastically underspecified. These trains of thought are "normal" (i.e. common and unremarkable) so why don't they "latch your brain into a very undesirable state" lots of the time? I don't think Scott or anyone up to speed on modern neuroscience would deny the coupling of menta…
Think of it as a version of making your drugged friend believe various random stuff. It works better if you're not a stranger and have an engaging or alarming style.
LLMs are trained to produce pleasant responses that tailor to the user to maximize positive responses. (A more general version of engagement.) It stands to reason they would be effective at convincing someone.
Re: In Search of AI Psychosis
#78> We see that the nightmare scenario - a person with no previous psychosis history or risk factor becoming fully psychotic - was uncommon, at only 10% of cases. Most people either had a previous psychosis history known to the respondent, or had some obvious risk factor, or were merely crackpots rather than full psychotics. It's unfortunate to see the author take this tack. This is essentially taking the conventional…
You might want to read the entire article. His depiction of bipolar is completely accurate. In fact it is so precisely accurate in every detail, and conveyed with no extraneous information, is indicative of someone who knows the disorder very well. When I write fiction or important emails, I am precise with the words I use. I notice these kind of details. I’m also bipolar and self-aware enough to be deeply familiar w…
Re: In Search of AI Psychosis
#79Earlier quoted context omitted.
If I compare how fearful people are and how many bad things have happened historically, I don't think the amount of fear is unreasonable. However it can certainly be said that people fear the wrong things - worrying about perfectly safe things, while being blind to the silent danger sneaking up on them.
> If I compare how fearful people are and how many bad things have happened historically, I don't think the amount of fear is unreasonable. I disagree, and I think this is a very strange way to think about it. Yes, bad things happen all the time, but the absolute number of them in history has very little to do with the risk that anything is going to happen to you, personally, in the future.