Last year ChatGPT helped save my life from having a stroke. LLMs are incredibly beneficial in providing medical information and advice today.
[dead]
ChatGPT terms disallow its use in providing legal and medical advice to others
311–320 of 439 posts
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#312I have seen more than once people using ChatGPT as a psychologist and psychiatrist and self diagnosing mental illnesses. It would be hilarious if it was not so disasterous. People with real questions get roped in by an enthusiastically confirming sycophantic model that will never question or push back, just confirm and lead on. Tbh, and I usually do not like this way of thought, but these are lawsuits waiting to happ…
It is awful, but at the same time this isn't new. People have for a long time used Google searches to self diagnose their issues. ChatGPT just makes that process ever easier now.
From my viewpoint it speaks more to a problem of the healthcare system.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#313I have seen more than once people using ChatGPT as a psychologist and psychiatrist and self diagnosing mental illnesses. It would be hilarious if it was not so disasterous. People with real questions get roped in by an enthusiastically confirming sycophantic model that will never question or push back, just confirm and lead on. Tbh, and I usually do not like this way of thought, but these are lawsuits waiting to happ…
> I have seen more than once people using ChatGPT as a psychologist and psychiatrist and self diagnosing mental illnesses. It would be hilarious if it was not so disasterous. What is the disaster?
It can help and also hurt, depends. You have some mild situation that is quite common? Good chance it will give you good advice.
Something more complex, more towards clinical psychiatry rather than shoulder to cry on/complaining to friend over coffee (psychologists)? You are playing a russian roulette that model in your case won't hallucinate something harmful, while acting very confidently, more than any relevant doctor would be.
There have been cases of models suggesting suicide for example or general harmful behavior. There is no responsibility, no oversight, no expert to confirm or refute claims. Its just a faster version of reddit threads.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#314Earlier quoted context omitted.
> LLMs are incredibly beneficial ... today. LLMs sometimes can be incredibly beneficial ... today LLMs sometimes can be incredibly harmful ... today Non-deterministic things aren't just one thing, they're whatever they happen to be in that particular moment.
Non-deterministic doesn't mean random or unpredictable. That's like saying the weather forecast is useless because it's not deterministic or always 100% accurate.
Non-deterministic means random - that's the definition of the word. The weather forecast is also random - in fact, weather forecast is (if you simplify it too much) an average of several predictive (generative) models.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#315I was wondering when they would start with the regulations. Next will be: you're allowed to use it, if your company/product is "HippocraticGPT"-certified, a bit like SOC or PCI compliance. This way they can craft an instance of GPT for your specific purposes (law, medicine, etc) and you know it's "safe" to use. This way they sell EE licenses, which is where the big $$$ are.
Or you'll need a prescription to be able to ask it health questions.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#316Earlier quoted context omitted.
So ask it what blood tests you should get, pay for them out of pocket, and upload the PDF of your labwork? Like it or not there are people out there that really want to use webMD 2.0. they're not going to let something silly like blood work get in their way.
Exactly. One of my children lives in a country where you can just walk in to a lab and get any test. Recently they were diagnosed by a professional of a disease which chatgpt had already diagnosed before they visited the doctor. So, we were kind of prepared to ask more questions when the visit happened. So I would say chatgpt did really help us.
That makes sense. ChatGPT helped by providing orientation advice and guidance regarding your children's medical condition. After that, however, you visited a doctor who is taking responsibility for the next steps. This is the ideal scenario.
AI can give you whatever information, be it good or wrong. But it takes zero responsibility.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#317Earlier quoted context omitted.
Non-deterministic doesn't mean random or unpredictable. That's like saying the weather forecast is useless because it's not deterministic or always 100% accurate.
Non-deterministic means random - that's the definition of the word. The weather forecast is also random - in fact, weather forecast is (if you simplify it too much) an average of several predictive (generative) models.
Inconsistent seems a more accessible word. It gives inconsistent results.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#318Grok will do mostly whatever you want. It's a tool and it's your personal responsibility to use it correctly. That's the way it should be. You don't need Sam Altman to babysit you, I hope.
> It's a tool and it's your personal responsibility to use it correctly.
Sure in theory, but this never works out in practice when applied to the populace. Replace "LLM" with other controversial things — social media, cigarettes, guns.
I'm also certain anyone outside the tech sphere who takes personal responsibility when using LLMs is not using Grok as their daily driver.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#319Earlier quoted context omitted.
Non-deterministic doesn't mean random or unpredictable. That's like saying the weather forecast is useless because it's not deterministic or always 100% accurate.
Last time I used GPT-4.5 to analyze blood results it gave different output if I uploaded it as 2 instead of 3 separated CSV files. It was both amazing experience: clear and easy to understand statements, and list of most common causes. And terrifying: "What about X?", "You ar absolutely right, there where X results included, disregard everything I wrote above, here is the new analysis". So for me non-deterministic me…
LLMs seem best at creative brainstorming, coming up with ideas to check that you hadn't thought of. Their weakness becomes a non-issue because ideas are just things for you to check the viability of, because they could be completely unworkable.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#320Earlier quoted context omitted.
He’s simply saying that ChatGPT was able to point them in the right direction after 1 chat exchange, compared to doctors who couldn’t for a long time. Edit: Not saying this is the case for the person above, but one thing that might bias these observations is ChatGPT’s memory features. If you have a chat about the condition after it’s diagnosed, you can’t use the same ChatGPT account to test whether it could have diag…
> He’s simply saying that ChatGPT was able to point them in the right direction after 1 chat exchange, compared to doctors who couldn’t for a long time He literally wrote that. I asked how he knows it's the right direction. it must be treatment worked. otherwise it is more or less just a hunch people go "oh yep that's definitely it" too easily. it is the problem with self diagnosing. And you didn't even notice it hap…
We had the diagnosis before I started with the LLM. The radiology showed the problem and the surgeries worked. Down to an ultrasound a year now!
We took him to our local ER, they ran tests. I gave the LLM just the symptom list that I gave to the ER initially. It replied with all the things they tested for. I gave the test results, and it suggested a short list with diagnostics that included his actual Dx and the correct way to test for it.