Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT terms disallow its use in providing legal and medical advice to others

ctvnews.ca

Post reply on HN
Print view View original

151–160 of 439 posts

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#151

Post by qustrolabe »

spullara wrote: post #74

This title is inaccurate. What they are disallowing are users using ChatGPT to offer legal and medical advice to other people. First parties can still use ChatGPT for medical and legal advice for themselves.

Yeah but it started being really annoying when you import something like Xray photo. Like chanting "sorry human as LLM I can't answer questions about that" and then after few gaslighting prompts it does it anyway but now I have to take in count that my gaslighting inputs seriously affect answers so way more chance it hallucinates...

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#152

Post by degamad »

gitremote wrote: post #81
Zr01 wrote: post #59

Earlier quoted context omitted.

I appreciate how the newer versions provide more links and references. It makes the task of verifying it (or at least where it got its results from) that much easier. What you're describing seems more like a advertisement problem, not a product problem. No matter how many locks and restrictions they put on it, someone, somwhere, will still find a way to get hurt from its advice. A hammer that's hard enough to beat na…

> What you're describing seems more like a advertisement problem, not a product problem. It's called "false advertising". https://en.wikipedia.org/wiki/False_advertising

Also known as "lying".

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#153

Post by thw_9a83c »

Johnny555 wrote: post #121
spullara wrote: post #74

This title is inaccurate. What they are disallowing are users using ChatGPT to offer legal and medical advice to other people. First parties can still use ChatGPT for medical and legal advice for themselves.

While they aren't stopping users from getting medical advice, the new terms (which they say are pretty much the same as the old terms), seem to prohibit users from seeking medical advice even for themselves if that advice would otherwise come from a licensed health professional: https://openai.com/en-GB/policies/usage-policies/ Your use of OpenAI services must follow these Usage Policies: Protect people. Everyone has…

It sounds like you should never trust any medical advice you receive from ChatGPT and should seek proper medical help instead. That makes sense. The OpenAI company doesn't want to be held responsible for any medical advice that goes wrong.

Obviously, there is one piece of advice: Even if LLMs were the best health professionals, they would only have the information that users voluntarily provide through text/speech input. This is not how real health services work. Medical science now relies on blood/(whatever) tests that LLMs do not (yet) have access to. Therefore, the output from LLM advice can be incorrect due to a lack of information from tests. For this reason, it makes sense to never trust LLM with a specific health advice.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#156

Post by artursapek »

rimbo789 wrote: post #154

That anyone would use any LLM for medical advice is beyond me. It’s webMD with slicker ui. Obviously they should disallow them and more broadly should be banned from providing anyone medical Advice

What’s wrong with WebMD? I’ve gotten a lot of value when it comes to questions about diet, supplements, exercise, even getting advice on incidents like my dog getting a porcupine quill in his paw. It’s a lot better than Googling for ancient forum threads.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#157

Post by renewiltord »

Ideally, we should be able to opt-in with a much higher fee. At the $200/mo tier I should be allowed to use this tool. The free users and lower tier paid users should be guard-railed. This is because those users all have trouble using this tool and then get upset at OpenAI and then we all have to endure endless news articles that we wouldn't if the good stuff were price-gated.

Those without money frequently have poor tool use, so eliminating them from the equation will probably allow the tool to be more useful. I don't have any trouble with it right now, but instead of making up fanciful stories about books I'm writing where characters choose certain exotic interventions in pursuit of certain rare medical conditions only to be struck down by their lack of subservience to The Scientific Consensus, I could just say I'm doing these things and that would be a little helpful in a UX sense.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#160

Post by fragmede »

rimbo789 wrote: post #154

That anyone would use any LLM for medical advice is beyond me. It’s webMD with slicker ui. Obviously they should disallow them and more broadly should be banned from providing anyone medical Advice

because that "slicker ui" is material. WebMD you have to look at their picture and deduce if you have cancer. ChatGPT (after you jailbreak it) will accept a picture of your weird growth directly.
Post reply on HN