They are basically prohibiting commercial use of their product. How the fuck are they ever going to even prove that you use it to generate money?
Same way commercial software vendors have done for decades?
ChatGPT terms disallow its use in providing legal and medical advice to others
111–120 of 439 posts
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#112This title is inaccurate. What they are disallowing are users using ChatGPT to offer legal and medical advice to other people. First parties can still use ChatGPT for medical and legal advice for themselves.
I keep seeing this problem more and more with humans. What should we call it? Maybe Hallucinations? Where there is an accurate true thing and then it just gets altered by these guys who call themselves journalists and reporters and the like until it is just ... completely unrecognizable? I'm pretty sure it's a fundamental issue with the architecture.
"Telephone", basically
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#113I been using Claude for information regarding building and construction related information, (currently building a small house mostly on my own with pros for plumbing and electrical). Seriously the amount of misinformation it has given me is quite staggering. Telling me things like, “you need to fill your drainage pipes with sand before pouring concrete over them…”, the danger with these AI products is that you have…
I'm a hobby woodworker - I've tried using gemini recently for an advice on how to make some tricky cuts. If I'd follow any of the suggestions I'd probably be in ER. Even after me pointing out issues and asking it to improve - it'd come up with more and more sophistical ways of doing same fundamentally dangerous actions. LLMs are AMAZING tools, but they are just that - tools. There's no actual intelligence there. And…
> I've tried using gemini recently for an advice on how to make some tricky cuts.
C'mon, just use the CNC. Seriously though, what kind of cuts?
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#114In summary, ChatGPT should only be used for entertainment.
It's not to be used for anything that could potentially have any sort of legal implications and thus get the vendor sued.
Because we all know it would be pretty easy to show in court that ChatGPT is less than reliable and trustworthy.
Next up --- companies banning the use of AI for work due to legal liability concerns --- triggering a financial market implosion centered around AI.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#115Earlier quoted context omitted.
The great thing is the models are sufficiently different enough, that when multiple come to the same conclusion, there is a good chance that conclusion is bound by real data. And I think this is the advice that should always be doled out when using them for anything mission critical, legal, etc.
All the models are pre-trained on the same one Internet.
"Bound by real data" meaning not hallucinations, which is by far the bigger issue when it comes to "be an expert that does x" that doesn't have a real capability to say "I don't know".
The chance of different models hallucinating the same plausible sounding but incorrect building codes, medical diagnoses, etc, would be incredible unlikely, due to arch differences, training approaches, etc.
So when two concur in that manner, unless they're leaning heavily on the same poisoned datasets, there's a healthy chance the result is correct based on a preponderance of known data.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#116Tricky…my son had a really rare congenital issue that no one could solve for a long time. After it was diagnosed I walked an older version of chat gpt through our experience and it suggested my son’s issue as a possibility along with the correct diagnostic tool in just one back and forth. I’m not saying we should be getting AI advice without a professional, but I’m my case it could have saved my kid a LOT of physical…
Why are you saying we shouldn't get AI advice without a "professional", then? Why is everybody here saying "in my experience it's just as good or better, but we need rules to make people use the worse option"? I have narcolepsy and it took a dozen doctors before they got it right. AI nails the diagnosis. Everybody should be using it.
Survivorship bias.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#117Article has since been updated for some clarity;
> Correction
[0] https://www.ctvnews.ca/sci-tech/article/chatgpt-users-cant-u...
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#118This title is inaccurate. What they are disallowing are users using ChatGPT to offer legal and medical advice to other people. First parties can still use ChatGPT for medical and legal advice for themselves.
I keep seeing this problem more and more with humans. What should we call it? Maybe Hallucinations? Where there is an accurate true thing and then it just gets altered by these guys who call themselves journalists and reporters and the like until it is just ... completely unrecognizable? I'm pretty sure it's a fundamental issue with the architecture.
Whenever I hear arguments about LLM hallucination, this is my first thought. Like, I already can't trust the lion's share of information in news, social media, (insert human-created content here). Sometimes because of abject disinformation, frequently just because humans are experts at being wrong.
At least with the LLM (for now) I know it's not trying to sell me bunkum or convince me to vote a particular way. Mostly.
I do expect this state of affairs to last at least until next wednesday.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#119Earlier quoted context omitted.
https://xcancel.com/thekaransinghal/status/19854160578054965... This is from Karan Singhal, Health AI team lead at OpenAI. Quote: “Despite speculation, this is not a new change to our terms. Model behavior remains unchanged. ChatGPT has never been a substitute for professional advice, but it will continue to be a great resource to help people understand legal and health information.”
I doubt his claims as i use chatgpt everyday heavily for medical advice (my profession) and it's responding differently now than before.
Maybe the usage policies are part of the system prompt, and ChatGPT is misreading the new wording as well. ;)
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#120Earlier quoted context omitted.
>After it was diagnosed I walked an older version of chat gpt through our experience and it suggested my son’s issue as a possibility along with the correct diagnostic tool in just one back and forth. Something I've noticed is that it's much easier to lead the LLM to the answer when you know where you want to go (even when the answer is factually wrong !), it doesn't have to be obvious leading but just framing the qu…
>checking my now diagnosed gastritis I got stuff from GERD to CRC depending on which symptoms I decide to stress and which events I emphasize in the history So... exactly the same behavior as human doctors?
ChatGPT and similar tools hallucinate and can mislead you.
Human doctors, on the other hand ... can be tired, hungover, thinking about a complicated case ahead of them, nauseous from a bad lunch, undergoing a divorce, alcoholics, depressed...
We humans have a lot of failure modes.