Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT terms disallow its use in providing legal and medical advice to others

ctvnews.ca

Post reply on HN
Print view View original

291–300 of 439 posts

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#291

Post by andsoitis »

PeterStuer wrote: post #273

I have seen more than once people using ChatGPT as a psychologist and psychiatrist and self diagnosing mental illnesses. It would be hilarious if it was not so disasterous. People with real questions get roped in by an enthusiastically confirming sycophantic model that will never question or push back, just confirm and lead on. Tbh, and I usually do not like this way of thought, but these are lawsuits waiting to happ…

> I have seen more than once people using ChatGPT as a psychologist and psychiatrist and self diagnosing mental illnesses. It would be hilarious if it was not so disasterous.

What is the disaster?

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#292

Post by DiscourseFan »

oblio wrote: post #290
VBprogrammer wrote: post #276

Earlier quoted context omitted.

You are failing to recognise all of the hard work which goes into "prompt engineering" to get AI to magically work!

It's the hardest work of all, it's basically voodoo, or put more generously, alchemy. Thankfully we have progressed so this time it will probably take less than 1000 years to progress to full blown chemistry :-)

Its more and more of a science everyday

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#293

Post by amelius »

xp84 wrote: post #258
shagie wrote: post #239

I read this not as "you can't ask ChatGPT about {medical or legal topic}" but rather "you can't build something on ChatGPT that provides {medical or legal} advice or support to someone else." For example, Epic couldn't embed ChatGPT into their application to have it read your forms for you. You can still ask it - but Epic can't build it. That said, I haven't found the specific terms and conditions that are mentioned…

And this seems actually wildly reasonable. It’s actually pretty scammy to take people’s money (or whatever your business model is) for legal or medical advice just to give them whatever AI shits out. If I wanted ChatGPT’s opinion (as I actually often do) I’d just ask ChatGPT for free or nearly-free. Anyone repackaging ChatGPT’s output as fit for a specialized purpose is scamming their customers.

Wait, so we cannot use the API anymore?

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#294

Post by amelius »

harvey9 wrote: post #277
procaryote wrote: post #271

I read this as "we disallow suing us for bad legal or medical advice"

If I pay for legal advice from you and all you did was give me chat gpt output, I can't sue openai anyway. This just clarifies that you can't put 'powered by chatgpt' on your AI lawyer service.

Well, you can if you used Chatgpt to write the HTML.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#295

Post by mk89 »

I was wondering when they would start with the regulations.

Next will be: you're allowed to use it, if your company/product is "HippocraticGPT"-certified, a bit like SOC or PCI compliance.

This way they can craft an instance of GPT for your specific purposes (law, medicine, etc) and you know it's "safe" to use.

This way they sell EE licenses, which is where the big $$$ are.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#296

Post by liampulles »

mk89 wrote: post #295

I was wondering when they would start with the regulations. Next will be: you're allowed to use it, if your company/product is "HippocraticGPT"-certified, a bit like SOC or PCI compliance. This way they can craft an instance of GPT for your specific purposes (law, medicine, etc) and you know it's "safe" to use. This way they sell EE licenses, which is where the big $$$ are.

I think this would apply if they sought out government regulation that applies to all AI players, not just their own company.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#297

Post by oblio »

DiscourseFan wrote: post #292
oblio wrote: post #290

Earlier quoted context omitted.

It's the hardest work of all, it's basically voodoo, or put more generously, alchemy. Thankfully we have progressed so this time it will probably take less than 1000 years to progress to full blown chemistry :-)

Its more and more of a science everyday

Yes, a more correct comparison would be early medicine: a science, but still filled with leeches and lancets.

Oh, and another thing, we still aren't able to quantify if AI coding is a net benefit. In my use cases the biggest benefit I get from it is as an enhanced code search, basically. Which has value, but I'm not sure it's a "$1 trillion per year business sector" kind of value.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#299

Post by District5524 »

modeless wrote: post #183

I wouldn't be surprised to see new products from OpenAI targeted specifically at doctors and/or lawyers. Forbidding them from using the regular ChatGPT with legal terms would be a good way to do price discrimination.

Read their paper on GDPval (https://arxiv.org/abs/2510.04374). In section 3, it's quite clear that their marketing strategy is now "to cooperate with professionals" and augment them. (Which does not rule out replacing them later, when the regulatory situation is more appropriate, like AGI is already a well-accepted fact, if ever.) But this will take a lot of time and local presence which they do not have.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#300

Post by fukka42 »

amelius wrote: post #293
xp84 wrote: post #258

Earlier quoted context omitted.

And this seems actually wildly reasonable. It’s actually pretty scammy to take people’s money (or whatever your business model is) for legal or medical advice just to give them whatever AI shits out. If I wanted ChatGPT’s opinion (as I actually often do) I’d just ask ChatGPT for free or nearly-free. Anyone repackaging ChatGPT’s output as fit for a specialized purpose is scamming their customers.

Wait, so we cannot use the API anymore?

To scam people? No.
Post reply on HN