Earlier quoted context omitted.
And when you’ve finally switched to the last LLM and it tells you it can’t answer you, and you decide not to use LLMs for important life-changing questions anymore, your world will be a better place.
Not really, no. I know I can't trust what the LLM tells me, I still want the answer. This should be a configurable option.
I misused LLMs to diagnose myself and ended up bedridden for a week
71–80 of 150 posts
Re: I misused LLMs to diagnose myself and ended up bedridden for a week
#72Yikes. But I have to say that prompt is crazy bad. AI is VERY good at using your prompt as the basis for the response, if you say "I don't think it's an emergency" AI will write a response that is "it's not an emergency" I did a test with the first prompt and the immediate answer I got was "this looks like lyme disease".
Well I tested the first prompt on ChatGPT and Llama and Claude and not one of them suggested Lyme disease. Goes to show how much these piece of shit clankers are good for. Llama said "syphilis" with 100% confidence, ChatGPT suggested several different random diseases, and Claude at least had the decency to respond "go to a fucking doctor, what are you stupid?", thereby proving to have more sense than many humans in t…
Re: I misused LLMs to diagnose myself and ended up bedridden for a week
#73[flagged]
Re: I misused LLMs to diagnose myself and ended up bedridden for a week
#74This is also about “don’t avoid going to the doctor”. Whether it was an LLM or a friend that “had that and it was nothing”, confirming that with a doctor is the sane approach no?
Re: I misused LLMs to diagnose myself and ended up bedridden for a week
#75Earlier quoted context omitted.
[flagged]
> How does this line up with your religious belief that doctors are infallible and should be 100% trusted? They did not say that in their comment. Replying in obvious bad faith makes your original comment even less credible than it already is.
Re: I misused LLMs to diagnose myself and ended up bedridden for a week
#76Fuck man if this is you go to the ER.
Re: I misused LLMs to diagnose myself and ended up bedridden for a week
#77Earlier quoted context omitted.
"Don't ask LLMs leading questions" is a perfectly valid lesson here too. If you're going to ask an LLM for a medical diagnosis, you should at the very least know how to use LLMs properly. I'm certainly not suggesting that you should ask LLM for medical diagnoses, but still, someone who actually understands the tool they're using would likely not have ended up in your situation.
If you're going to ask an LLM for a medical diagnosis, stop what you're doing and ask a doctor instead. There is no good advice downstream of the decision to ask an LLM for a medical diagnosis
Should they not have done so?
Like this guy for example, was he being stupid? https://www.thesun.co.uk/health/37561550/teen-saves-life-cha...
Or this guy? https://www.reddit.com/r/ChatGPT/comments/1krzu6t/chatgpt_an...
Or this woman? https://news.ycombinator.com/item?id=43171639
This is a real thing that's happening every day. Doctors are not very good at recognizing rare conditions.
Re: I misused LLMs to diagnose myself and ended up bedridden for a week
#78Earlier quoted context omitted.
I think it's morally wrong to trust a child's well-being to an LLM over a trained medical professional, and I feel strongly enough about this to express that here.
I agree with you, and reading some of the takes in this thread is actually blowing my mind. I cannot believe that the top-voted comment right now is saying to not trust doctors, use an LLM to diagnose yourself and others.
I'll share mine.
Unusual severe one sided eye pain. Go to regular doctor's, explain, get told it's a "stye" and do hot compresses.
Problem gets worse, I go to urgent care. Urgent care doc takes one look at me and immediately sends me to the ER saying it's severe and she can't diagnose it because she is unqualified.
Go to ER, get seen by two specialists, a general practicioner and a gaggle of nurses. Get told it's a bad eye infection, put on strong steroids.
Problem gets worse (more slowly at least).
Schedule an urgent appoint with an opthalmologist. For some reason the scheduling lady just like, comprehends my urgency and gets me a same day appointment.
Opthalmologist does 5 minutes of exam, puts in some eye drops and pain is immediately gone. She puts me on a very serious steroid with instructions to dose hourly and visit her daily. Only reason I am seeing out of both eyes today.
As the top comment says, do not just "trust" Doctors. About 70% of hospital deaths are due to preventable mistakes in the hospital. People who are invested in their own care, who seek second opinions, who argue (productively) with their doctor have the best outcomes by far.
Nobody said not to work with doctors, but blindly trusting a single doctor will seriously harm your outcomes.
Re: I misused LLMs to diagnose myself and ended up bedridden for a week
#79Also: Amoxicillin is better than its reputation. Three doctors might literally recommend four different antibiotic dosages and schedules. Double-check everything; your doctor might be at the end of a 12-hour shift and is just as human as you. Lyme is very common and best treated early.
Edit: Fixed formating
Re: I misused LLMs to diagnose myself and ended up bedridden for a week
#80Earlier quoted context omitted.
If you're going to ask an LLM for a medical diagnosis, stop what you're doing and ask a doctor instead. There is no good advice downstream of the decision to ask an LLM for a medical diagnosis
What about the multiple people who have reported receiving incredibly useful information after asking an LLM, when doctors were useless? Should they not have done so? Like this guy for example, was he being stupid? https://www.thesun.co.uk/health/37561550/teen-saves-life-cha... Or this guy? https://www.reddit.com/r/ChatGPT/comments/1krzu6t/chatgpt_an... Or this woman? https://news.ycombinator.com/item?id=43171639 Thi…
They got lucky.
This is why I wrote this blog post. I'm sure some people got lucky when an LLM managed to give them the right answer, because they go and brag about it. How many people got the wrong answer? How many of them bragged about their bad decision? This is _selection bias_. I'm writing about my embarrassing lapse of judgment because I doubt anyone else will