Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT terms disallow its use in providing legal and medical advice to others

ctvnews.ca

Post reply on HN
Print view View original

191–200 of 439 posts

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#191

Post by bitwize »

Johnny555 wrote: post #121
spullara wrote: post #74

This title is inaccurate. What they are disallowing are users using ChatGPT to offer legal and medical advice to other people. First parties can still use ChatGPT for medical and legal advice for themselves.

While they aren't stopping users from getting medical advice, the new terms (which they say are pretty much the same as the old terms), seem to prohibit users from seeking medical advice even for themselves if that advice would otherwise come from a licensed health professional: https://openai.com/en-GB/policies/usage-policies/ Your use of OpenAI services must follow these Usage Policies: Protect people. Everyone has…

CYA move. If some bright spark decides to consult Dr. ChatGPT without input from a human M.D., and fucks their shit up as a result, OpenAI can say "not our responsibility, as that's actually against our ToS."

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#192

Post by mensetmanusman »

ares623 wrote: post #128
terminalshort wrote: post #110

Earlier quoted context omitted.

Why are you saying we shouldn't get AI advice without a "professional", then? Why is everybody here saying "in my experience it's just as good or better, but we need rules to make people use the worse option"? I have narcolepsy and it took a dozen doctors before they got it right. AI nails the diagnosis. Everybody should be using it.

How do you hold the AI accountable when it makes a mistake? Can you take away its license "individually"?

If it makes a mistake? You’re not required to follow the AI, just use it as a tool for consideration.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#193

Post by ares623 »

mensetmanusman wrote: post #192
ares623 wrote: post #128

Earlier quoted context omitted.

How do you hold the AI accountable when it makes a mistake? Can you take away its license "individually"?

If it makes a mistake? You’re not required to follow the AI, just use it as a tool for consideration.

Doesn't sound very $1 trilliony

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#194

Post by caturopath »

Johnny555 wrote: post #121
spullara wrote: post #74

This title is inaccurate. What they are disallowing are users using ChatGPT to offer legal and medical advice to other people. First parties can still use ChatGPT for medical and legal advice for themselves.

While they aren't stopping users from getting medical advice, the new terms (which they say are pretty much the same as the old terms), seem to prohibit users from seeking medical advice even for themselves if that advice would otherwise come from a licensed health professional: https://openai.com/en-GB/policies/usage-policies/ Your use of OpenAI services must follow these Usage Policies: Protect people. Everyone has…

Would be interested to hear a legal expert weigh in on what 'advice' is. I'm not clear that discussing medical and legal issues with you is necessarily providing advice.

One of the things I respected OpenAI for at the release of ChatGPT was not trying to prevent these topics. My employer at the time had a cutting-edge internal LLM chatbot for a which was post-trained to avoid them, something I think they were forced to be braver about in their public release because of the competitive landscape.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#195

Post by caturopath »

sarchertech wrote: post #162
thw_9a83c wrote: post #153

Earlier quoted context omitted.

It sounds like you should never trust any medical advice you receive from ChatGPT and should seek proper medical help instead. That makes sense. The OpenAI company doesn't want to be held responsible for any medical advice that goes wrong. Obviously, there is one piece of advice: Even if LLMs were the best health professionals, they would only have the information that users voluntarily provide through text/speech in…

And it’s not just lab tests and bloodwork. Physicians use all their senses. They poke, they prod, they manipulate, they look, listen, and smell. They’re also good at extracting information in a way that (at least currently) sycophantic LLMs don’t replicate.

> Physicians use all their senses. They poke, they prod, they manipulate, they look, listen, and smell.

Sometimes. Sometimes they practice by text or phone.

> They’re also good at extracting information in a way that (at least currently) sycophantic LLMs don’t replicate.

If I had to guess, I think I'd guess that mainstream LLM chatbots are better at getting honest and applicable medical histories than most doctors. People are less likely to lie/hide/prevaricate and get more time with the person.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#196

Post by caturopath »

zamadatix wrote: post #182
whatsupdog wrote: post #178

Earlier quoted context omitted.

Here in Canada ever since COVID most "visits" are a telephone call now. So the doctor just listens your words (same as a text input to an LLM) and orders tests (which can be uploaded to an LLM) if they need.

For a good 90% of typical visits to doctors this is probably fine. The difference is a telehealth is much better at recognizing "I can't given an accurate answer for this over the phone, you'll need to have some tests done" or cast doubt on the patient's accuracy of claims. Before someone points out telehealth doctors aren't perfect at this: correct, but that should make you more scared of how bad sycophantic LLMs ar…

> telehealth is much better at recognizing "I can't given an accurate answer for this over the phone, you'll need to have some tests done"

I'm not sure this is true.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#198

Post by navigate8310 »

Johnny555 wrote: post #180
thw_9a83c wrote: post #153

Earlier quoted context omitted.

It sounds like you should never trust any medical advice you receive from ChatGPT and should seek proper medical help instead. That makes sense. The OpenAI company doesn't want to be held responsible for any medical advice that goes wrong. Obviously, there is one piece of advice: Even if LLMs were the best health professionals, they would only have the information that users voluntarily provide through text/speech in…

>It sounds like you should never trust any medical advice you receive from ChatGPT and should seek proper medical help instead. That makes sense. The OpenAI company doesn't want to be held responsible for any medical advice that goes wrong. While what you're saying is good advice, that's not what they are saying. They want people to be able to ask ChatGPT for medical advice, give answers that sound authoritative and…

At times the advice is genuinely helpful. However, it's practically impossible to measure under what exact situations the advice would be accurate.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#199

Post by bfLives »

ares623 wrote: post #128
terminalshort wrote: post #110

Earlier quoted context omitted.

Why are you saying we shouldn't get AI advice without a "professional", then? Why is everybody here saying "in my experience it's just as good or better, but we need rules to make people use the worse option"? I have narcolepsy and it took a dozen doctors before they got it right. AI nails the diagnosis. Everybody should be using it.

How do you hold the AI accountable when it makes a mistake? Can you take away its license "individually"?

Does it matter? I’d rather use a 90% accurate tool than an 80% accurate one that I can subject to retribution.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#200

Post by throwaway314155 »

johaugum wrote: post #170
spullara wrote: post #74

This title is inaccurate. What they are disallowing are users using ChatGPT to offer legal and medical advice to other people. First parties can still use ChatGPT for medical and legal advice for themselves.

Isn’t that exactly what the title says?

Indeed. Also confused.
Post reply on HN