Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT terms disallow its use in providing legal and medical advice to others

ctvnews.ca

Post reply on HN
Print view View original

321–330 of 439 posts

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#321

Post by throwaway290 »

cpfohl wrote: post #320
throwaway290 wrote: post #181

Earlier quoted context omitted.

> He’s simply saying that ChatGPT was able to point them in the right direction after 1 chat exchange, compared to doctors who couldn’t for a long time He literally wrote that. I asked how he knows it's the right direction. it must be treatment worked. otherwise it is more or less just a hunch people go "oh yep that's definitely it" too easily. it is the problem with self diagnosing. And you didn't even notice it hap…

We had the diagnosis before I started with the LLM. The radiology showed the problem and the surgeries worked. Down to an ultrasound a year now! We took him to our local ER, they ran tests. I gave the LLM just the symptom list that I gave to the ER initially. It replied with all the things they tested for. I gave the test results, and it suggested a short list with diagnostics that included his actual Dx and the corr…

That's great that it worked so quickly too (and you could arrange surgery on such short notice). I'm sure more people with same issue may benefit from more details?

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#322

Post by odyssey7 »

sans_souse wrote: post #117

Article has since been updated for some clarity; > Correction An earlier version of this story suggested OpenAI had ended medical and legal advice. However the company said "the model behaviour has also not changed." [0] [0] https://www.ctvnews.ca/sci-tech/article/chatgpt-users-cant-u...

Marketing masterpiece

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#324

Post by bamboozled »

fny wrote: post #55
bamboozled wrote: post #5

I been using Claude for information regarding building and construction related information, (currently building a small house mostly on my own with pros for plumbing and electrical). Seriously the amount of misinformation it has given me is quite staggering. Telling me things like, “you need to fill your drainage pipes with sand before pouring concrete over them…”, the danger with these AI products is that you have…

I mean... you do have to backfill around your drainage pipe, so it's not too far off. Frankly, if you Google the subject people misspeak about "backfilling pipes" too as if the target of the backfill is the pipe itself too not the trench. Garbage in, garbage out. All the circumstances where ChatGPT has given me shoddy advice fall in three buckets: 1. The internet lacks information, so LLMs will invent answers 2. The…

I mean... you do have to backfill around your drainage pipe, so it's not too far off

Really? You think filling you pipe with sand is comparable to backfilling a trench ?

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#325

Post by mschuster91 »

uyzstvqs wrote: post #309

Grok will do mostly whatever you want. It's a tool and it's your personal responsibility to use it correctly. That's the way it should be. You don't need Sam Altman to babysit you, I hope.

As long as Elon keeps messing with Grok because the facts it uses aren't compatible with his world view [1], I'll stay away from it as far as possible.

And even leaving the political questions aside - the thing is being molded into a goon generator [2], just WTF.

[1] https://edition.cnn.com/2025/06/27/tech/grok-4-elon-musk-ai

[2] https://www.theatlantic.com/technology/2025/09/grok-system-p...

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#326

Post by miki123211 »

xp84 wrote: post #258
shagie wrote: post #239

I read this not as "you can't ask ChatGPT about {medical or legal topic}" but rather "you can't build something on ChatGPT that provides {medical or legal} advice or support to someone else." For example, Epic couldn't embed ChatGPT into their application to have it read your forms for you. You can still ask it - but Epic can't build it. That said, I haven't found the specific terms and conditions that are mentioned…

And this seems actually wildly reasonable. It’s actually pretty scammy to take people’s money (or whatever your business model is) for legal or medical advice just to give them whatever AI shits out. If I wanted ChatGPT’s opinion (as I actually often do) I’d just ask ChatGPT for free or nearly-free. Anyone repackaging ChatGPT’s output as fit for a specialized purpose is scamming their customers.

What if Chat GPT is used as a "power tool" for actual legal / medical professionals?

E.G. Here's the set of documents uploaded by the customer. Here are my most important highlights (notice that document #68 is an official letter from last year informing the person that form 68d doesn't need to be filled in their specific situation). Here are my takeaways. Here's my recommendation. Apporve or change?

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#327

Post by tylervigen »

junon wrote: post #275
shagie wrote: post #239

I read this not as "you can't ask ChatGPT about {medical or legal topic}" but rather "you can't build something on ChatGPT that provides {medical or legal} advice or support to someone else." For example, Epic couldn't embed ChatGPT into their application to have it read your forms for you. You can still ask it - but Epic can't build it. That said, I haven't found the specific terms and conditions that are mentioned…

(For anyone misunderstanding the reference to Epic, it's the name of an electronic healthcare record system widely used in American hospitals, not the game company Epic Games)

And for anyone who wants to be nerd sniped by this one comment chain, the Acquired podcast recently did an episode on Epic and it is great.

Title: "Epic Systems (MyChart)."

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#328

Post by agentcoops »

xp84 wrote: post #258
shagie wrote: post #239

I read this not as "you can't ask ChatGPT about {medical or legal topic}" but rather "you can't build something on ChatGPT that provides {medical or legal} advice or support to someone else." For example, Epic couldn't embed ChatGPT into their application to have it read your forms for you. You can still ask it - but Epic can't build it. That said, I haven't found the specific terms and conditions that are mentioned…

And this seems actually wildly reasonable. It’s actually pretty scammy to take people’s money (or whatever your business model is) for legal or medical advice just to give them whatever AI shits out. If I wanted ChatGPT’s opinion (as I actually often do) I’d just ask ChatGPT for free or nearly-free. Anyone repackaging ChatGPT’s output as fit for a specialized purpose is scamming their customers.

Indeed. Similarly, I like now having ChatGPT as the absolute lowest bar of service I’m willing to accept. If you aren’t a better therapist, lawyer or programmer than it then why would I think about paying you.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#329

Post by agentcoops »

miki123211 wrote: post #326
xp84 wrote: post #258

Earlier quoted context omitted.

And this seems actually wildly reasonable. It’s actually pretty scammy to take people’s money (or whatever your business model is) for legal or medical advice just to give them whatever AI shits out. If I wanted ChatGPT’s opinion (as I actually often do) I’d just ask ChatGPT for free or nearly-free. Anyone repackaging ChatGPT’s output as fit for a specialized purpose is scamming their customers.

What if Chat GPT is used as a "power tool" for actual legal / medical professionals? E.G. Here's the set of documents uploaded by the customer. Here are my most important highlights (notice that document #68 is an official letter from last year informing the person that form 68d doesn't need to be filled in their specific situation). Here are my takeaways. Here's my recommendation. Apporve or change?

As long as their service offering is better than me typing the question into my phone I’m fine with it.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#330

Post by saberience »

eecc wrote: post #301
andsoitis wrote: post #291

Earlier quoted context omitted.

> I have seen more than once people using ChatGPT as a psychologist and psychiatrist and self diagnosing mental illnesses. It would be hilarious if it was not so disasterous. What is the disaster?

"People with real questions get roped in by an enthusiastically confirming sycophantic model that will never question or push back, just confirm and lead on." That wasn't too buried IMHO

This isn’t accurate though, the models do push back and do question.

I would say ChatGPT is way way better than the average therapist. I’ve seen maybe between 15-20 psychotherapists over the course of my life and ChatGPT is better than 85% of them I would wager.

I’ve had a therapist recommend me take a motorbike trek across Europe (because that’s what he did) to cure my depression.

I think people tend to radically overestimate the skills of the average therapist, many are totally fucking shit.

Post reply on HN