Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT terms disallow its use in providing legal and medical advice to others

ctvnews.ca

Post reply on HN
Print view View original

171–180 of 439 posts

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#171

Post by sarchertech »

ghostly_s wrote: post #145
Johnny555 wrote: post #121

Earlier quoted context omitted.

While they aren't stopping users from getting medical advice, the new terms (which they say are pretty much the same as the old terms), seem to prohibit users from seeking medical advice even for themselves if that advice would otherwise come from a licensed health professional: https://openai.com/en-GB/policies/usage-policies/ Your use of OpenAI services must follow these Usage Policies: Protect people. Everyone has…

I don't think giving someone "medical advice" in the US requires a license per se; legal entities use "this is not medical advice" type disclaimers just to avoid liability.

What’s illegal is practicing medicine. Giving medical advice can be “practicing medicine” depending on how specific it is and whether a reasonable person receiving the advice thinks you have medical training.

Disclaimers like “I am not a doctor and this is not medical advice” aren’t just for avoiding civil liability, they’re to make it clear that you aren’t representing yourself as a doctor.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#172

Post by simonw »

nh43215rgb wrote: post #141
simonw wrote: post #122

Earlier quoted context omitted.

But OpenAI's head of Health AI says that ChatGPT's behavior has not changed: https://xcancel.com/thekaransinghal/status/19854160578054965... and https://x.com/thekaransinghal/status/1985416057805496524 I trust what he says over general vibes. (If you think he's lying, what's your theory on WHY he would lie about a change like this?)

My theory is that he believes 1) people will trust him over what general public say, and 2) this kind of claim is hard to verify to prove him wrong.

That doesn't answer why he would lie about this, just why the thinks he would get away with it. What's his motive?

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#174

Post by ekianjo »

sarchertech wrote: post #162
thw_9a83c wrote: post #153

Earlier quoted context omitted.

It sounds like you should never trust any medical advice you receive from ChatGPT and should seek proper medical help instead. That makes sense. The OpenAI company doesn't want to be held responsible for any medical advice that goes wrong. Obviously, there is one piece of advice: Even if LLMs were the best health professionals, they would only have the information that users voluntarily provide through text/speech in…

And it’s not just lab tests and bloodwork. Physicians use all their senses. They poke, they prod, they manipulate, they look, listen, and smell. They’re also good at extracting information in a way that (at least currently) sycophantic LLMs don’t replicate.

> They poke, they prod, they manipulate, they look, listen, and smell.

Rarely. Most visits are done in 5 minutes. The physician that takes their time to check everything like you claim almost does not exist anymore.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#175

Post by jackvalentine »

el_benhameen wrote: post #123
rafaelmn wrote: post #38

Earlier quoted context omitted.

>After it was diagnosed I walked an older version of chat gpt through our experience and it suggested my son’s issue as a possibility along with the correct diagnostic tool in just one back and forth. Something I've noticed is that it's much easier to lead the LLM to the answer when you know where you want to go (even when the answer is factually wrong !), it doesn't have to be obvious leading but just framing the qu…

In January my daughter had a pretty scary stomach issue that had us in the ER twice in 24 hours and that ended in surgery (just fine now). The first ER doc thought it was just a stomach ache, the second thought a stomach ache or maybe appendicitis. Did some ultrasounds, meds, etc. Got sent home with a pat on the head, came back a few hours later, still no answers. I gave her medical history and all of the data from t…

Malrotation?

We had in our family a “doctors are confused!” experience that ended up being that.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#176

Post by dimitri-vs »

sarchertech wrote: post #162
thw_9a83c wrote: post #153

Earlier quoted context omitted.

It sounds like you should never trust any medical advice you receive from ChatGPT and should seek proper medical help instead. That makes sense. The OpenAI company doesn't want to be held responsible for any medical advice that goes wrong. Obviously, there is one piece of advice: Even if LLMs were the best health professionals, they would only have the information that users voluntarily provide through text/speech in…

And it’s not just lab tests and bloodwork. Physicians use all their senses. They poke, they prod, they manipulate, they look, listen, and smell. They’re also good at extracting information in a way that (at least currently) sycophantic LLMs don’t replicate.

Agreed, but I'm sure you can see why people prefer the infinite patience and availability of ChatGPT vs having to wait weeks to see your doctor, see them for 15 minutes only to be referred to another specialist that's available weeks away and has an arduous hour long intake process all so you can get 15 minutes of their time.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#177

Post by SlavikCA »

tencentshill wrote: post #33
cpfohl wrote: post #3

Tricky…my son had a really rare congenital issue that no one could solve for a long time. After it was diagnosed I walked an older version of chat gpt through our experience and it suggested my son’s issue as a possibility along with the correct diagnostic tool in just one back and forth. I’m not saying we should be getting AI advice without a professional, but I’m my case it could have saved my kid a LOT of physical…

We are all obligated to hoard as many offline AI models as possible if the larger ones are legally restricted like this.

Google released MedGemma model: "optimized for medical text and image comprehension".

I use it. Found it to be helpful.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#178

Post by whatsupdog »

ekianjo wrote: post #174
sarchertech wrote: post #162

Earlier quoted context omitted.

And it’s not just lab tests and bloodwork. Physicians use all their senses. They poke, they prod, they manipulate, they look, listen, and smell. They’re also good at extracting information in a way that (at least currently) sycophantic LLMs don’t replicate.

> They poke, they prod, they manipulate, they look, listen, and smell. Rarely. Most visits are done in 5 minutes. The physician that takes their time to check everything like you claim almost does not exist anymore.

Here in Canada ever since COVID most "visits" are a telephone call now. So the doctor just listens your words (same as a text input to an LLM) and orders tests (which can be uploaded to an LLM) if they need.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#179

Post by whatsupdog »

fragmede wrote: post #168
thw_9a83c wrote: post #153

Earlier quoted context omitted.

It sounds like you should never trust any medical advice you receive from ChatGPT and should seek proper medical help instead. That makes sense. The OpenAI company doesn't want to be held responsible for any medical advice that goes wrong. Obviously, there is one piece of advice: Even if LLMs were the best health professionals, they would only have the information that users voluntarily provide through text/speech in…

So ask it what blood tests you should get, pay for them out of pocket, and upload the PDF of your labwork? Like it or not there are people out there that really want to use webMD 2.0. they're not going to let something silly like blood work get in their way.

Exactly. One of my children lives in a country where you can just walk in to a lab and get any test. Recently they were diagnosed by a professional of a disease which chatgpt had already diagnosed before they visited the doctor. So, we were kind of prepared to ask more questions when the visit happened. So I would say chatgpt did really help us.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#180

Post by Johnny555 »

thw_9a83c wrote: post #153
Johnny555 wrote: post #121

Earlier quoted context omitted.

While they aren't stopping users from getting medical advice, the new terms (which they say are pretty much the same as the old terms), seem to prohibit users from seeking medical advice even for themselves if that advice would otherwise come from a licensed health professional: https://openai.com/en-GB/policies/usage-policies/ Your use of OpenAI services must follow these Usage Policies: Protect people. Everyone has…

It sounds like you should never trust any medical advice you receive from ChatGPT and should seek proper medical help instead. That makes sense. The OpenAI company doesn't want to be held responsible for any medical advice that goes wrong. Obviously, there is one piece of advice: Even if LLMs were the best health professionals, they would only have the information that users voluntarily provide through text/speech in…

>It sounds like you should never trust any medical advice you receive from ChatGPT and should seek proper medical help instead. That makes sense. The OpenAI company doesn't want to be held responsible for any medical advice that goes wrong.

While what you're saying is good advice, that's not what they are saying. They want people to be able to ask ChatGPT for medical advice, give answers that sound authoritative and well grounded medical science, but then disavow any liability if someone follows their advice because "Hey, we told you not to act on our medical advice!"

If ChatGPT is so smart, why can't it stop itself from giving out advice that should not be trusted?

Post reply on HN