ChatGPT terms disallow its use in providing legal and medical advice to others

Post by simianwords » Thu, Nov 06, 2025, 8:28 AM UTC

Jweb_Guru wrote: post #257

thinkingtoilet wrote: post #92

Earlier quoted context omitted.

What capabilities? The article says the study found it was entirely correct 31% of the time.

This is what really scares me about people using AI. It will confidently hallucinate studies and quotes that have absolutely no basis in reality, and even in your own field you're not going to know whether what it's saying is real or not without following up on absolutely every assertion. But people are happy to completely buy its diagnoses of rare medical conditions based on what, exactly?

Post by oarsinsync » Thu, Nov 06, 2025, 8:30 AM UTC

adangert wrote: post #278

Last year ChatGPT helped save my life from having a stroke. LLMs are incredibly beneficial in providing medical information and advice today.

Post by outside1234 » Thu, Nov 06, 2025, 8:44 AM UTC

Post by _yvnd » Thu, Nov 06, 2025, 9:17 AM UTC

junon wrote: post #275

shagie wrote: post #239

I read this not as "you can't ask ChatGPT about {medical or legal topic}" but rather "you can't build something on ChatGPT that provides {medical or legal} advice or support to someone else." For example, Epic couldn't embed ChatGPT into their application to have it read your forms for you. You can still ask it - but Epic can't build it. That said, I haven't found the specific terms and conditions that are mentioned…

(For anyone misunderstanding the reference to Epic, it's the name of an electronic healthcare record system widely used in American hospitals, not the game company Epic Games)

Post by KeplerBoy » Thu, Nov 06, 2025, 9:28 AM UTC

oarsinsync wrote: post #283

adangert wrote: post #278

Last year ChatGPT helped save my life from having a stroke. LLMs are incredibly beneficial in providing medical information and advice today.

> LLMs are incredibly beneficial ... today. LLMs sometimes can be incredibly beneficial ... today LLMs sometimes can be incredibly harmful ... today Non-deterministic things aren't just one thing, they're whatever they happen to be in that particular moment.