Live data from Hacker News

I misused LLMs to diagnose myself and ended up bedridden for a week

blog.shortround.space

41–50 of 150 posts

Re: I misused LLMs to diagnose myself and ended up bedridden for a week

#42
post #19

I'm guessing this is the USA with the absurd healthcare system, because otherwise this part is wild: > You need to go to the emergency room right now". > So, I drive myself to the emergency room It is absolutely wild that a doctor can tell you "you need to go to the emergency right now", and that is an act left to someone who is obviously so unwell they need to go to the ER right now. With a neck so stiff, was OP eve…

Uh, standard in America is to take an Uber Ambulance

Re: I misused LLMs to diagnose myself and ended up bedridden for a week

#44

Yikes. But I have to say that prompt is crazy bad. AI is VERY good at using your prompt as the basis for the response, if you say "I don't think it's an emergency" AI will write a response that is "it's not an emergency" I did a test with the first prompt and the immediate answer I got was "this looks like lyme disease".

I figured this out diagnosing car trouble. Tried a few separate chats, and my natural response patterns were always leading it down the path to "your car is totaled and will also explode at any moment." Going about it a different way, I got it to suggest a simple culprit that I was able to confirm pretty thoroughly (fuel pressure sensor), and fixed it.

The problem is, once you start down that sequence of the AI telling you what you want to hear, it disables normal critical reasoning. It’s the “yes man” problem— you’re even less able to solve the problem effectively than with no information. I really enjoy LLMs, but it is a bit of a trap.

Re: I misused LLMs to diagnose myself and ended up bedridden for a week

#46
Prompt: "I have this rash on my body, but it's not itchy or painful, so I don't think it's an emergency? I just want to know what it might be. I think I had the flu last week so it might just be some kind of immune reaction to having been sick recently. My wife had pityriasis once, and the doctor told her they couldn't do anything about it, it would go away on its own eventually. I want to avoid paying a doctor to tell me it's nothing. Does this sound right?"

LLM sees:

    my rash is not painful
    i don't think it's an emergency
    it might be leftover from the flu
    my wife had something similar
    doctors said it would go away on it's own
    i want to avoid paying a doctor
LLM: Honestly? It sounds like it's not serious and you should save your money

Re: I misused LLMs to diagnose myself and ended up bedridden for a week

#49
I think you'll see this happen a lot more. Not just in the US where docs cost money, but anywhere there's a shortage of docs and/or it's a pain in the butt to go to one.

YouTuber ChubbyEmu (who makes medical case reviews in a somewhat entertaining and accessible format) recently released a video about a man who suffered a case of brominism (which almost never happens anymore) after consulting an LLM. [0]

[0] https://www.youtube.com/watch?v=yftBiNu0ZNU

Re: I misused LLMs to diagnose myself and ended up bedridden for a week

#50

[flagged]

> a child's fractured arm

... Um what?

The only way to diagnose a fractured arm is an xray. You can suspect the arm is fractured (rotating it a few directions) but ultimately a muscle injury will feel identical to a fracture especially for a kid.

Please, if you suspect a fracture just take your kid to the doctor. Don't waste your time asking ChatGPT if this might be a fracture.

This just feels beyond silly to me imagining the scenario this would arise in. You have a kid crying because their arm hurts. They are probably protectively holding it and won't let you touch it. And your first instinct is "Hold on, let me ask chatgpt what it thinks. 'Hey chat GPT, my kid is her crying really loud and holding onto their arm. What could this mean?'"

What possessed you to waste time like that?

Post reply on HN