I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
inflecthealth.medium.com
I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
1–10 of 368 posts
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#2Ah yes, the "everyone lies" House M.D. problem
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#3Ah yes, the "everyone lies" House M.D. problem
Not even, ChatGPT, being an engine that figures out what's right by finding out what is average, is bad at understanding the atypical.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#4It’s funny because it’s almost the exact same problem I have with using it professionally for writing software.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#5It’s funny because it’s almost the exact same problem I have with using it professionally for writing software.
Seconding.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#6[flagged]
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#7I'm not really sure what he expected here, ChatGPT was not trained to be a doctor, it is far more general than that. Asking ChatGPT for medical advice is like asking someone who is very well read but has no experience as a doctor, and in that context it's doing very well.
He also brings up one of the most salient points without really visiting it enough: ChatGPT does not ask for clarification, because it is not a knowledge base trying to find an answer. All it does is figure out what character is statistically most likely to come next, it has no heuristic to know that there is a task it hasn't fully completed.
This is the same reason ChatGPT cannot yet write programs by itself: in order to do so you'd need to specify the entire program up front (which is exactly what code is).
As soon as we have agents that can do a proper feedback loop of querying a LLM consecutively until some heuristic is reached then the kind of AI doctors are looking for will emerge.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#8There are two types of medical conditions
1) Those you see a doctor for
2) Those you don't
The line depends on where you live. In a poor village, 100% might be the latter, while an executive in SFO will see a doctor for anything serious, but might not if they cut themselves with a kitchen knife.
What's underrated is the ability to have basic medical care and information everywhere, all the time, for free.
That can be casual injuries below the threshold of visiting a doctor (am I better heating or icing? immobilizing or stretching?), or those can be settings where there are no doctors.
Even more, doctors (like AIs) make mistakes, and it's often helpful having a second opinion.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#9I am curious if GPT-4 would have performed better.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#10It's amazing that it was that effective...
- It's a generalized language model; imagine how much more effective it would be with a specialized ai that used a variety of techniques that are better suited for logic and reasoning, while using llms to interact with patients.
- It cost an order of magnitude less than the visit to a doctor.
- The potential in being able to constantly monitor a patient - a point made in the post.