Live data from Hacker News

Illinois limits the use of AI in therapy and psychotherapy

washingtonpost.com

131–140 of 262 posts

Re: Illinois limits the use of AI in therapy and psychotherapy

#131
post #55
post #45

Earlier quoted context omitted.

"A really fucking bad idea"? It's not one word, but it is the most apt description.

What if it works 20x better. For examples cases of patients being afraid of talking to professionals I could see this working much better.

Even if you're afraid of talking to people, trusting OpenAI or Google with your thoughts over a professional who'll lose his license if he breaks confidentiality is no less of "a really fucking bad idea".

Re: Illinois limits the use of AI in therapy and psychotherapy

#133

Here is what Illinois says: https://idfpr.illinois.gov/content/dam/soi/en/web/idfpr/news... I get the impression that it is now illegal in Illinois to claim that an AI chatbot can take the place of a licensed therapist or counselor. That doesn't mean people can't do what they want with AI. It only means that counseling services can't offer AI as a cheaper replacement for a real person. Am I wrong? This sounds good to…

I think this sort of service would be OK with informed consent. I would actually be a little surprised if there were much difference in patient outcomes. …And it turns out it has been studied with findings that AI work, but humans are better. https://pmc.ncbi.nlm.nih.gov/articles/PMC11871827/

Usually when it comes to medical stuff, things don't get approved unless they are better than existing therapies. With the shortage of mental health care in the US, maybe an exception should be made. This is a tough one. We like to think that nobody should have to get second rate medical care, even though that's the reality.

Re: Illinois limits the use of AI in therapy and psychotherapy

#134

Earlier quoted context omitted.

What if at some point an AI is developed that’s a better therapist AND it’s cheaper?

I'm probably in the minority here, but for me it's a foregone conclusion that it will become a better therapist, doctor, architect, etc. Instead of the rich getting access to the best professionals, it will level the playing field. The average low level lawyer, doctor, etc are not great. How nice if everyone got top level help.

I've never been to a therapist for anything that can be described as a diagnosable condition, but I have spoken to one about stress management and things of that ilk. For "amusement" I discussed similar things with an LLM.

At a surface level, the LLM was far more accessible. I didn't have to schedule an appointment weeks in advance. Even with the free tier, I didn't have to worry about time limits per se. There were limits, to be sure, but I could easily think about a question or the LLM's response before responding. In my case, what mattered was turnaround time on my terms rather than an in depth discussion. There was also less concern about being judged, both by another human and in a way that could get back to my employer because, yeah, it was employment related stress and the only way I could afford human service was through insurance offered by my employer. While there are significant privacy concerns with LLM's as they stand today, you don't have that direct relationship between who is offering it and the people in your life.

On a deeper level, I simply felt the advice was presented in a more useful form. The human discussions were framed by exercises to be completed between sessions. While the exercises were useful, the feedback was far from immediate and the purpose of the exercises is best described as a delaying tactic: it provided a framework for deeper thought between discussions because discussions were confined to times that were available to both parties. LLMs are more flexible. They are always available. Rather than dealing with big exercises to delay the conversation by a couple of weeks, they can be bite sized exercises to enable the next step. On top of that, LLMs allow for an expanded scope of discussion. Remember, I'm talking about workplace stress in my particular case. An LLM doesn't care whether you are talking about how you personally handle stress, or about how you manage a workplace in order to reduce stress for yourself and others.

Now I'm not going to pretend that this sort of arrangement is useful in all cases. I certainly wouldn't trust it for a psychological or medical diagnosis, and I would trust it even less for prescribed medications. On the other hand, people who cannot afford access to traditional professional services are likely better served by LLMs. After all, there are plenty of people who will offer advice. Those people range from well meaning friends who may lack the scope to offer valid advice, to snake-oil salesmen who could care less about outcomes as long as it contributes to their bottom line. Now I'm not going to pretend that LLMs care about me. On the other hand, they don't care about squeezing me for everything I have either. While the former will never change, I'll admit that the latter may. But I don't foresee that in the immediate future since I suspect the vendors of these models won't push for it until they have established their role in the market place.

Re: Illinois limits the use of AI in therapy and psychotherapy

#135

Here is what Illinois says: https://idfpr.illinois.gov/content/dam/soi/en/web/idfpr/news... I get the impression that it is now illegal in Illinois to claim that an AI chatbot can take the place of a licensed therapist or counselor. That doesn't mean people can't do what they want with AI. It only means that counseling services can't offer AI as a cheaper replacement for a real person. Am I wrong? This sounds good to…

What's good about reducing options available for therapy? If the issue is misrepresentation, there are already laws that cover this.

It's not really reducing options. There's no evidence that LLM chat bots are capable of providing effective mental health services.

Re: Illinois limits the use of AI in therapy and psychotherapy

#136

What if it works a third as well as a therapists but is 20 times cheaper? What word should we use for that?

Last I heard, most therapy doesn't work that well.

If you have some statistics you should probably post a link. I've heard all kinds of things, and a lot of them were nothing like factual.

Re: Illinois limits the use of AI in therapy and psychotherapy

#137

Here is what Illinois says: https://idfpr.illinois.gov/content/dam/soi/en/web/idfpr/news... I get the impression that it is now illegal in Illinois to claim that an AI chatbot can take the place of a licensed therapist or counselor. That doesn't mean people can't do what they want with AI. It only means that counseling services can't offer AI as a cheaper replacement for a real person. Am I wrong? This sounds good to…

What's good about reducing options available for therapy? If the issue is misrepresentation, there are already laws that cover this.

For human therapists, what’s good is that it preserves their ability to charge high fees because the demand for therapists far outstrips the supply.

Who lobbied for this law anyway?

Re: Illinois limits the use of AI in therapy and psychotherapy

#138

Earlier quoted context omitted.

I'm probably in the minority here, but for me it's a foregone conclusion that it will become a better therapist, doctor, architect, etc. Instead of the rich getting access to the best professionals, it will level the playing field. The average low level lawyer, doctor, etc are not great. How nice if everyone got top level help.

Wouldn’t the rich afford a much better trained, larger, and computationally more intensive model?

does it matter? If mine is way better than I had before, why does it matter that someone else's is better still? My sister's $130 Moto G is much better than whatever phone she could afford 10 years. Does it matter that it's not a $1599 iPhone 16 Pro Max 1TB?

Re: Illinois limits the use of AI in therapy and psychotherapy

#139

Earlier quoted context omitted.

I'm probably in the minority here, but for me it's a foregone conclusion that it will become a better therapist, doctor, architect, etc. Instead of the rich getting access to the best professionals, it will level the playing field. The average low level lawyer, doctor, etc are not great. How nice if everyone got top level help.

It would still need to be regulated and licensed. There was this [0] I saw today about a guy who tried to replace sodium chloride in his diet with sodium bromide because ChatGPT said he could, and poisoned himself. With a regulated license, there is someone to hold accountable for wantonly dangerous advice, much like there is with humans. [0] https://x.com/AnnalsofIMCC/status/1953531705802797070

There are two different issues here. One is tied to how authoritative we view a source, and the other is tied to the weaknesses of the person receiving advice.

With respect to the former, I firmly believe that the existing LLMs should not be presented as a source for authoritative advice. Giving advice that is not authoritative is okay as long as the recipient realizes such, in the sense that it is something that people have to deal with outside of the technological realm anyhow. For example, if you ask for help for a friend you are doing so with the understanding that, as a friend, they are doing so to the best of their ability. Yet you don't automatically assume they are right. They are either right because they do the footwork for you to ensure accuracy or you check the accuracy of what they are telling you yourself. Likewise, you don't trust the advice of a stranger unless they are certified, and even that depends upon trust in the certifying body.

I think the problem with technology is that we assume it is a cure-all. While we may not automatically trust the results returned by a basic Google search, a basic Google search result coupled with an authoritative sounding name automatically sounds more accurate than a Google search result that is a blog posting. (I'm not suggesting this is the only criteria people use. You are welcome to insert your own criteria in its place.) Our trust of LLMs, as they stand today, is even worse. Few people have developed criteria beyond: it is an LLM, so it must be trustworthy; or, it is an LLM so it must not be trustworthy. And, to be fair, it is bloody difficult to develop criteria for the trustworthiness of LLMs (even arbitrary criteria) because the provide so few cues.

Then there's the bit about the person receiving the advice. There's not a huge amount we can do about that beyond encouraging people regard the results from LLMs as stepping stones. That is to say they should take the results and do research that will either confirm or deny it. But, of course, many people are lazy and nobody has the expertise to analyze the output of an LLM outside of their personal experience/training.

Re: Illinois limits the use of AI in therapy and psychotherapy

#140

Earlier quoted context omitted.

I'm probably in the minority here, but for me it's a foregone conclusion that it will become a better therapist, doctor, architect, etc. Instead of the rich getting access to the best professionals, it will level the playing field. The average low level lawyer, doctor, etc are not great. How nice if everyone got top level help.

Why is that a foregone conclusion?

Because meat isn't magic. Anything that can be computed inside your physical body, can be calculated in an "artificially" constructed replica. Given enough time, we'll create that replica, there's no reason to think otherwise.
Post reply on HN