[flagged]
ChatGPT terms disallow its use in providing legal and medical advice to others
261–270 of 439 posts
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#262Earlier quoted context omitted.
If you're not a doctor, how do you know it's accurate? This is the huge problem with using LLMs for this kind of thing. How do you verify that it is better? What is the ground truth you are testing it against? If you wanted to verify that ChatGPT could do math, you'd ask it 100 math problems and then (importantly) verify its answers with a calculator. How do you verify that ChatGPT can interpret medical information w…
I know it’s hard to accept, but it’s got to be weighed against the real-world alternative: You get about 5-8 minutes of face time with an actual doctor, but have to wait up to weeks to actually get in to see a doctor, except maybe at an urgent care or ER. Or people used to just play around on WebMD which was even worse since it wasn’t in any way tailored to what the patient’s stated situation is. There’s the rest of…
I get what you're saying, and I agree it might be fun to play around with ChatGPT and Wikipedia and YouTube and WebMD to try to guess what that green bump on your arm is, but it's not research--it needs to be treated as entertainment.
When it comes to taking actual real-world action, I would take 5-8 minutes with a real doctor over 5-8 months of browsing the Internet. The doctor has gone to med school, passed the boards, done his residency, and you at least have that as evidence that he might know what he is doing. The Internet offers no such evidence.
I fear that our society in general is quickly entering a very dangerous territory where there's no such thing as expertise, and unaccountable, probabilistic tools and web resources of unknown provenience are seen as just as good as an expert in his field.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#263This strikes ma as a bit unnecessary, like forbidding people from using chatGPT to develop nuclear power plants. I mean, there is a lot of professional activities that are licensed , and for good reason. Sure it's good at a lot of stuff, but ChatGPT has no professional licenses.
I'm glad you mentioned nuclear power plants because this whole topic reminded me of the following clause in the Java SE license: > You will not use the Programs for, and will not allow the Programs to be used for, any purposes prohibited by applicable law, including, without limitation, for the development, design, manufacture or production of nuclear, chemical or biological weapons of mass destruction. > > https://w…
I just saw almost the exact same clause when installing VMWare recently. My understanding is that its a standard clause that exists to stay within compliance of US Export Control laws
> EXPORT CONTROL: You acknowledge that the Software is of United States origin, is provided subject to the U.S. Export Administration Regulations...(2) you will not permit the Software to be used for any purposes prohibited by law, including, any prohibited development, design, manufacture or production of missiles or nuclear, chemical or biological weapons.
>https://docs.broadcom.com/docs/vmware-vsphere-software-devel...
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#264I read this not as "you can't ask ChatGPT about {medical or legal topic}" but rather "you can't build something on ChatGPT that provides {medical or legal} advice or support to someone else." For example, Epic couldn't embed ChatGPT into their application to have it read your forms for you. You can still ask it - but Epic can't build it. That said, I haven't found the specific terms and conditions that are mentioned…
And this seems actually wildly reasonable. It’s actually pretty scammy to take people’s money (or whatever your business model is) for legal or medical advice just to give them whatever AI shits out. If I wanted ChatGPT’s opinion (as I actually often do) I’d just ask ChatGPT for free or nearly-free. Anyone repackaging ChatGPT’s output as fit for a specialized purpose is scamming their customers.
Your comment actually hints at this towards the end but yeah this doesn’t just apply to medical and legal topics.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#265Earlier quoted context omitted.
I know it’s hard to accept, but it’s got to be weighed against the real-world alternative: You get about 5-8 minutes of face time with an actual doctor, but have to wait up to weeks to actually get in to see a doctor, except maybe at an urgent care or ER. Or people used to just play around on WebMD which was even worse since it wasn’t in any way tailored to what the patient’s stated situation is. There’s the rest of…
I get what you're saying, and I agree it might be fun to play around with ChatGPT and Wikipedia and YouTube and WebMD to try to guess what that green bump on your arm is, but it's not research--it needs to be treated as entertainment. When it comes to taking actual real-world action, I would take 5-8 minutes with a real doctor over 5-8 months of browsing the Internet. The doctor has gone to med school, passed the boa…
I don't disagree with you, but if I prompted an LLM to ask me questions like a doctor would for a non-invasive assessment, would it ask me better or worse questions than an actual doctor?
I ask (somewhat rhetorically) to get the mind thinking, but I'm legitimately curious whether - just from a verbal survey - whether the AI doctor would ask me about things more directly related to any illness it might suspect, versus a human who might narrow factors down similar to a 90s TV "ghost speaker" type of person; one fishing for matches amongst a fairly large dataset.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#266That’s a fair limitation. Legal and medical advice can directly impact someone’s life or safety, so AI tools must stay within ethical and regulatory boundaries. It’s better for AI to guide people toward professional help than pretend to replace it.
> Legal and medical advice can directly impact someone’s life or safety, so AI tools must stay within ethical and regulatory boundaries
Knives can be used to cook food and stab other people. By your suggestion, knives must be forbidden/limited as well?
If people following chatgpt advise (or any other stupid source for that matter), it's a not a ChatGPT but the people, issue.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#267Earlier quoted context omitted.
If you're not a doctor, how do you know it's accurate? This is the huge problem with using LLMs for this kind of thing. How do you verify that it is better? What is the ground truth you are testing it against? If you wanted to verify that ChatGPT could do math, you'd ask it 100 math problems and then (importantly) verify its answers with a calculator. How do you verify that ChatGPT can interpret medical information w…
Nobody would use these services for anything important if they _actually understood_ these glorified markov chains are just as likely to confidently assert something false and lie about it when pressed as they are to produce accurate information. These AI companies have sold a bill of goods but the right people are making money off it so they’ll never be held responsible in a scenarios the one you described.
Isn't statistical analysis a legitimate tool for helping diagnosis since forever? It's not exactly surprising that a pattern matcher does reasonably well at matching symptoms to diseases.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#268Earlier quoted context omitted.
If you're not a doctor, how do you know it's accurate? This is the huge problem with using LLMs for this kind of thing. How do you verify that it is better? What is the ground truth you are testing it against? If you wanted to verify that ChatGPT could do math, you'd ask it 100 math problems and then (importantly) verify its answers with a calculator. How do you verify that ChatGPT can interpret medical information w…
Nobody would use these services for anything important if they _actually understood_ these glorified markov chains are just as likely to confidently assert something false and lie about it when pressed as they are to produce accurate information. These AI companies have sold a bill of goods but the right people are making money off it so they’ll never be held responsible in a scenarios the one you described.
What is the most likely cause of this set of facts is how diagnostics works. LLMs are tailor made for this type of use case.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#269Earlier quoted context omitted.
I’ve found it just as accurate and a better experience than using telehealth or generalist doctors
If you're not a doctor, how do you know it's accurate? This is the huge problem with using LLMs for this kind of thing. How do you verify that it is better? What is the ground truth you are testing it against? If you wanted to verify that ChatGPT could do math, you'd ask it 100 math problems and then (importantly) verify its answers with a calculator. How do you verify that ChatGPT can interpret medical information w…
How does anyone know if what the doctor says is accurate? Obviously people should put the most relative weight in their doctor's opinion, but there's a reason people always say to get a second opinion.
Unfortunately because of how the US healthcare system works today people have to become their own doctors and advocates. LLMs are great at surfacing the unknown unknowns, and I think can help people better prepare for the rare 5 minutes they get to speak to an actual doctor.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#270I've used ChatGPT to help understand medical records too. It's definitely faster than searching everything on my own, but whether the information is reliable still depends on personal judgment or asking a real doctor. More people are treating it like a doctor or lawyer now, and the more it's used that way, the higher the chance something goes wrong. OpenAI is clearly drawing a line here. You're free to ask questions,…
You should not be feeding your medical records into ChatGPT.
And you shouldn't be using Gmail or Google Search. At some point the benefits outweigh the costs.