Why Can't Epic's AI model Detect Sepsis?
explainthispaper.com
Why Can't Epic's AI model Detect Sepsis?
1–10 of 19 posts
Re: Why Can't Epic's AI model Detect Sepsis?
#2Granted this is the review of a single model, but given that it's by one of the big players in the EMR space, it shows how challenging this problem is. Sepsis is easy to under-recognise, and difficult to identify reliably without lots (and lots) of false alarms.
Re: Why Can't Epic's AI model Detect Sepsis?
#3> Why Can't AI Detect Sepsis?
> (...)
> The details of ESM's development is proprietary
That last word is why.
Re: Why Can't Epic's AI model Detect Sepsis?
#4I used to work in emergency medicine as a paramedic. A far cry from an MD for sure, but here's my two cents: Unless they were already in decline, I never suspected Sepsis based solely on vitals. It was usually more of a gut feel thing. It can present with weird symptoms, like unexplained joint pain in multiple joints and things like that. I think that two key tells are patient history and patient cognition relative to baseline. My favorite question to ask family is: "How are they normally?" It's hard to measure these things with vitals so the AI doesn't have the right data going in, IMO. But, take all this with a grain of salt as I am deeply uninformed on the subject.
Re: Why Can't Epic's AI model Detect Sepsis?
#5I think this headline is slightly misleading since the writeup doesn't really go into the "why" or generalize past Epic's performance.
The TLDR is much more accurate: "A widely used sepsis prediction tool demonstrated poor performance in an independent validation, with worse results than clinician judgement and an increased burden of alert fatigue."
Re: Why Can't Epic's AI model Detect Sepsis?
#6> Why Can't AI Detect Sepsis? > (...) > The details of ESM's development is proprietary That last word is why.
Can you add more detail to this thought, other than just trying to vaguely affiliate proprietary tech with failure?
Re: Why Can't Epic's AI model Detect Sepsis?
#7The title is misleading and wrong. "AI" from a specific company(Epic) can't detect sepsis. But technology exists from people that known what they are doing, such as Johns Hopkin's spin-off Bayesian [1], and they have been very successful in detecting Sepsis.
Re: Why Can't Epic's AI model Detect Sepsis?
#8It looks like Duke University School Of Medicine figured it out.
https://physicians.dukehealth.org/articles/dukes-augmented-i...
(after I posted this, the title of this story has changed to be EPIC-specific - it was "Why Can't AI Detect Sepsis?")
Re: Why Can't Epic's AI model Detect Sepsis?
#9> Why Can't AI Detect Sepsis? > (...) > The details of ESM's development is proprietary That last word is why.
Can you add more detail to this thought, other than just trying to vaguely affiliate proprietary tech with failure?
One of the problems with closed models is that any model can be found to train on the 'wrong' data point. So e.g. a chest x ray reader determines that images taken with the machine in ICU indicate sicker patients than elsewhere- that's not useful. If you can't inspect the model to check that, they might claim superior performance, but then the model doesn't work as well as advertised when it's tried out. Other biases might occur as well- for instance you can imagine a 'Greyball for healthcare' with the wrong incentives which recommends a certain drug/therapy more often than it should.
Re: Why Can't Epic's AI model Detect Sepsis?
#10The title is misleading and wrong. "AI" from a specific company(Epic) can't detect sepsis. But technology exists from people that known what they are doing, such as Johns Hopkin's spin-off Bayesian [1], and they have been very successful in detecting Sepsis. [1] https://www.bayesianhealth.com
That's fair- I've edited the title to make it more specific. I've not come across Bayesian but I'm going to add their research on the site to summarise down the line.