Towards accurate differential diagnosis with large language models
1–10 of 99 posts
Re: Towards accurate differential diagnosis with large language models
#2Yikes, do I read this correctly and the LLM alone outperforms clinician + LLM?
Re: Towards accurate differential diagnosis with large language models
#3Differential diagnosis >
Machine differential diagnosis: https://en.wikipedia.org/wiki/Differential_diagnosis
CDSS: Clinical Decision Support System: https://en.wikipedia.org/wiki/Clinical_decision_support_syst...
Treatment decision support: https://en.wikipedia.org/wiki/Treatment_decision_support :
> Treatment decision support consists of the tools and processes used to enhance medical patients’ healthcare decision-making. The term differs from clinical decision support, in that clinical decision support tools are aimed at medical professionals, while treatment decision support tools empower the people who will receive the treatments
AI in healthcare: https://en.wikipedia.org/wiki/Artificial_intelligence_in_hea...
Re: Towards accurate differential diagnosis with large language models
#4I wonder if they made any effort to check whether the NEJM case studies that this whole study is based are in the PALM-2 training dataset.
Re: Towards accurate differential diagnosis with large language models
#5If it's not already obvious, LLMs are going to be doing most of the mental work currently performed by doctors, lawyers, accountants, etc.
I have already nearly stopped using Google search for anything, in favor of GPT-4.
GPT-4 has helped me very quickly prototype things that I normally would have had to spend hours researching.
GPT-4 has also created custom curriculum for me to help me learn various things for which I have struggled to find good books/tutorials online.
There will always be many areas in which a solid human intellect and well-honed human judgment is still useful, but much of the less critical work will yield to LLMs.
If we call the difference between GPT-3 and GPT4 1x, then I would expect to see a 2x-5x improvement in LLM capability within the next few years just based on how much great work has recently gone into shrinking really big models so they can run on smaller hardware.
LLMs are not digital human minds, they are simply very good information synthesizers. Information synthesis happens to be what most white collar professionals get paid to do with their brains.
Re: Towards accurate differential diagnosis with large language models
#6Yikes, do I read this correctly and the LLM alone outperforms clinician + LLM?
Yeah, it's a bit awkward.
Re: Towards accurate differential diagnosis with large language models
#7If it's not already obvious, LLMs are going to be doing most of the mental work currently performed by doctors, lawyers, accountants, etc. I have already nearly stopped using Google search for anything, in favor of GPT-4. GPT-4 has helped me very quickly prototype things that I normally would have had to spend hours researching. GPT-4 has also created custom curriculum for me to help me learn various things for which…
[dead]
Re: Towards accurate differential diagnosis with large language models
#8Yikes, do I read this correctly and the LLM alone outperforms clinician + LLM?
This has come up before in similar contexts. Model based decision decisions tend to do better than clinicians alone or clinicians with the model based decision system in general. Despite this it’s been effectively impossible to deploy such systems in a clinical setting due to many issues but one is that clinicians aren’t willing to cede their ground and patients aren’t willing to believe the machine over a human.
Re: Towards accurate differential diagnosis with large language models
#9If it's not already obvious, LLMs are going to be doing most of the mental work currently performed by doctors, lawyers, accountants, etc. I have already nearly stopped using Google search for anything, in favor of GPT-4. GPT-4 has helped me very quickly prototype things that I normally would have had to spend hours researching. GPT-4 has also created custom curriculum for me to help me learn various things for which…
> If it's not already obvious, LLMs are going to be doing most of the mental work currently performed by doctors, lawyers, accountants, etc.
While I don't know you personally and I'm not talking about you specifically, "just" feeling very excited about something doesn't Make This About You, the prognostications don't actually help you Be a Part of This.
This is the same energy as being really into COVID-19 (what was it called, "corona-scrolling?"), the gambling-fueled crypto boom, the retail stock trading booms. It's kind of adjacent to the fallacy Feelings that are More Strongly Held Are More Valid.
It's like you could use these things as a barometer for the health of a social media channel.
Anyway, I'm sure there's a name for this part of the hype cycle - tapping into how people want to be a part of the number one biggest, hottest trend by, at the very least, talking about it all the time, trying to compete against each other by sucking the most air out of all rooms through ever-greater hyperbole.
One thing's for sure: there's some guy who found some massive low hanging fruit in some neural network designs by carefully choosing brackets in chained matrix multiplications. That's one guy, and he definitely Made It About Him in a way that makes sense. How many people on Earth have enough knowledge to see things like that, maybe 1,000-10,000? It's so exclusive, in a sense.
I guess my point is, you're pretty far off the mark. In the interest of curiosity: Standard practice in medicine is to examine the patient before giving an opinion, a big roadblock for even the most competent of multi-modal models. Also, most people are biased in that they are intimately familiar with their own lived health problems, so they fill in tons of blanks, discounting the value of inquiry during a consult, whereas doctors may see you for less than a few hours a year, LLMs much less so.
Re: Towards accurate differential diagnosis with large language models
#10Yikes, do I read this correctly and the LLM alone outperforms clinician + LLM?
It also outperforms clinician + googling which the study observed (many doctors use google search to help with diagnosis, terminology, recent studies, etc)