Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Illinois limits the use of AI in therapy and psychotherapy

washingtonpost.com

Post reply on HN
Print view View original

121–130 of 262 posts

Re: Illinois limits the use of AI in therapy and psychotherapy

#121

Post by zdragnar »

awesomeusername wrote: post #81
linotype wrote: post #74

Earlier quoted context omitted.

What if at some point an AI is developed that’s a better therapist AND it’s cheaper?

I'm probably in the minority here, but for me it's a foregone conclusion that it will become a better therapist, doctor, architect, etc. Instead of the rich getting access to the best professionals, it will level the playing field. The average low level lawyer, doctor, etc are not great. How nice if everyone got top level help.

It would still need to be regulated and licensed. There was this [0] I saw today about a guy who tried to replace sodium chloride in his diet with sodium bromide because ChatGPT said he could, and poisoned himself.

With a regulated license, there is someone to hold accountable for wantonly dangerous advice, much like there is with humans.

[0] https://x.com/AnnalsofIMCC/status/1953531705802797070

Re: Illinois limits the use of AI in therapy and psychotherapy

#122

Post by heyjamesknight »

lokar wrote: post #102
ceejayoz wrote: post #72

Earlier quoted context omitted.

Yes, but with extra contracts and rules in place.

At least in the us I think HIPPA would cover this, and IME medical providers are very careful to select products and services that comply.

Yes, but HIPAA is notoriously vague with regards to what actual security measures have to be in place. Its more of an agreement between parties as to who is liable in case of a breach than it is a specific set of guidelines like SOC 2.

If your medical files are locked in the trunk of a car, that’s “HIPAA-compliant” until someone steals the car.

Re: Illinois limits the use of AI in therapy and psychotherapy

#123

Post by jakelazaroff »

davidthewatson wrote: post #47

Define "AI therapy". AFAICT, it's undefined in the Illinois governor's statement. So, in the immortal words of Zach de la Rocha, "What is IT?" What is IT? I'm using AI to help with conversations to not cure, but coach diabetic patients. Does this law effect me and my clients? If so, how?

Totally beside the point but the song you're quoting is by Faith No More, not Rage Against the Machine.

Re: Illinois limits the use of AI in therapy and psychotherapy

#125

Post by jakelazaroff »

ipaddr wrote: post #55
_se wrote: post #45

Earlier quoted context omitted.

"A really fucking bad idea"? It's not one word, but it is the most apt description.

What if it works 20x better. For examples cases of patients being afraid of talking to professionals I could see this working much better.

> What if it works 20x better.

But it doesn't.

Re: Illinois limits the use of AI in therapy and psychotherapy

#126

Post by sssilver »

awesomeusername wrote: post #81
linotype wrote: post #74

Earlier quoted context omitted.

What if at some point an AI is developed that’s a better therapist AND it’s cheaper?

I'm probably in the minority here, but for me it's a foregone conclusion that it will become a better therapist, doctor, architect, etc. Instead of the rich getting access to the best professionals, it will level the playing field. The average low level lawyer, doctor, etc are not great. How nice if everyone got top level help.

Wouldn’t the rich afford a much better trained, larger, and computationally more intensive model?

Re: Illinois limits the use of AI in therapy and psychotherapy

#127

Post by larodi »

kylecazar wrote: post #60

"One news report found an AI-powered therapist chatbot recommended “a small hit of meth to get through this week” to a fictional former addict." Not at all surprising. I don't understand why seemingly bright people think this is a good idea, despite knowing the mechanism behind language models. Hopefully more states follow, because it shouldn't be formally legal in provider settings. Informally, people will continue…

In a world where a daily dose of amphetamines is just right for millions of people, this somehow cant be that surprising...

Re: Illinois limits the use of AI in therapy and psychotherapy

#128

Post by reaperducer »

linotype wrote: post #74
hathawsh wrote: post #13

Here is what Illinois says: https://idfpr.illinois.gov/content/dam/soi/en/web/idfpr/news... I get the impression that it is now illegal in Illinois to claim that an AI chatbot can take the place of a licensed therapist or counselor. That doesn't mean people can't do what they want with AI. It only means that counseling services can't offer AI as a cheaper replacement for a real person. Am I wrong? This sounds good to…

What if at some point an AI is developed that’s a better therapist AND it’s cheaper?

What if at some point an AI is developed that’s a better therapist AND it’s cheaper?

Probably they'll the change the law.

Hundreds of laws change every day.

Re: Illinois limits the use of AI in therapy and psychotherapy

#129

Post by larodi »

jacobsenscott wrote: post #40
lukev wrote: post #8

Good. It's difficult to imagine a worse use case for LLMs.

It's already happening, a lot. I don't think anyone is claiming an llm is a therapist, but people use chatgpt for therapy every day. As far as I know no LLM company is taking any steps to prevent this - but they could, and should be forced to. It must be a goldmine of personal information. I can't imagine some therapists, especially remote only, aren't already just acting as a human interface to chatgtp as well.

Of course they do, and everyone does, and it's your like in this song

https://www.youtube.com/watch?v=u1xrNaTO1bI

and given price of proper therapy is skyrocketing.

Re: Illinois limits the use of AI in therapy and psychotherapy

#130

Post by larodi »

tombert wrote: post #112

I saw a video recently that talked about a chatbot "therapist" that ended up telling the patient to murder a dozen people [1]. It was mind-blowing how easy it was to get LLMs to suggest pretty disturbing stuff. [1] https://youtu.be/lfEJ4DbjZYg?si=bcKQHEImyDUNoqiu

very easy - you just download the ablated version in LM Studio or Ollama, and off you go.

https://en.wikipedia.org/wiki/Ablation_(artificial_intellige...

Post reply on HN