Live data from Hacker News

ChatGPT terms disallow its use in providing legal and medical advice to others

ctvnews.ca

31–40 of 439 posts

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#31
post #25

When OpenAI is done getting rid of all the cases where its AI gives dangerously wrong advice about licensed professions, all that will be left is the cases where its AI gives dangerously wrong advice about unlicensed professions.

[flagged]

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#32

Sounds like it is still giving out medical and legal information just adding CYA disclaimers.

It would be terribly boring if it didn't. Just last night I had it walk me through reptile laws in my state to evaluate my business plan for a vertically integrated snapping turtle farm and turtle soup restaurant empire. Absurd, but it's fun to use for this kind of thing because it almost always takes you seriously.

(Turns out I would need permits :-( )

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#33
post #3

Tricky…my son had a really rare congenital issue that no one could solve for a long time. After it was diagnosed I walked an older version of chat gpt through our experience and it suggested my son’s issue as a possibility along with the correct diagnostic tool in just one back and forth. I’m not saying we should be getting AI advice without a professional, but I’m my case it could have saved my kid a LOT of physical…

We are all obligated to hoard as many offline AI models as possible if the larger ones are legally restricted like this.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#35

It's not stopping to give legal/medical advice to the user, but it's forbidden to use ChatGPT to pose as an advisor giving advice to others: https://www.tomsguide.com/ai/chatgpt/chatgpt-will-still-offe...

One wonders how exactly this will be enforced.

It's not about enforcing this, it's about OpenAI having their asses covered. The blame is now clearly on the user's side.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#36
As a doctor I hope it still allows me to get up to speed on latest treatments for rare diseases that I see once every 10 years. It saves me a lot of time rather than having to dig through all the new information since I last encountered a rare disease.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#37
post #28

The cynic in me thinks this is just a means to eventually make more money by offering paid unrestricted versions to medical and legal professionals. I'm well-aware that it's not a truth machine, and any output it provides should be verified, checked for references, and treated with due diligence. Yet the same goes for just about any internet search. I don't think some people not knowing how to use it warrants restric…

If they do that, they will be subject of regulations on medical devices. As they should be and means the end result will be less likely to promote complete crap then it is now.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#38
post #3

Tricky…my son had a really rare congenital issue that no one could solve for a long time. After it was diagnosed I walked an older version of chat gpt through our experience and it suggested my son’s issue as a possibility along with the correct diagnostic tool in just one back and forth. I’m not saying we should be getting AI advice without a professional, but I’m my case it could have saved my kid a LOT of physical…

>After it was diagnosed I walked an older version of chat gpt through our experience and it suggested my son’s issue as a possibility along with the correct diagnostic tool in just one back and forth.

Something I've noticed is that it's much easier to lead the LLM to the answer when you know where you want to go (even when the answer is factually wrong !), it doesn't have to be obvious leading but just framing the question in terms of mentioning all the symptoms you now know to be relevant in the order that's diagnosable, etc.

Not saying that's the case here, you might have gotten the correct answer first try - but checking my now diagnosed gastritis I got stuff from GERD to CRC depending on which symptoms I decide to stress and which events I emphasize in the history.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#39
post #25

When OpenAI is done getting rid of all the cases where its AI gives dangerously wrong advice about licensed professions, all that will be left is the cases where its AI gives dangerously wrong advice about unlicensed professions.

Aka software engineers…
Post reply on HN