AI models miss disease in Black and female patients
1–10 of 256 posts
Re: AI models miss disease in Black and female patients
#2[flagged]
Re: AI models miss disease in Black and female patients
#3This seems like a problem that should be worked on
It also seems like we shouldn't let it prevent all AI deployment in the interim. It is better that we take the disease detection rate for part of the population up a few percent than we do not. Plus it's not like doctors or radiologists always diagnose at perfectly equal accuracy across all populations.
Let's not let the perfect become the enemy of the good.
Re: AI models miss disease in Black and female patients
#4Just like doctors: https://kffhealthnews.org/news/article/medical-misdiagnosis-...
I wonder how well it does with folks that have chronic conditions like type 1 diabetes as a population.
Maybe part of the problem is that we're treating these tools like humans that have to look at one fuzzy picture to figure things out. A 'multi-modal' model that can integrate inputs like raw ultrasound doppler, x-ray, ct scan, blood work, ekg, etc etc would likely be much more capable than a human counterpart.
Re: AI models miss disease in Black and female patients
#5It seems critical to have diverse, inclusive, and equitable data for model training. (I call this concept "DIET".)
Re: AI models miss disease in Black and female patients
#6[deleted]
Re: AI models miss disease in Black and female patients
#7Humans do the same. Everything from medical studies to doctor trainings treat the straight white man as the "default human" and this obviously leads to all sorts of issues. Caroline Criado-Perez has an entire chapter about this in her book about systemic bias Invisible Women, with a scary number of examples and real world consequences.
It's no surprise that AI training sets reflect this also. People have been warning against it [0] specifically for at least 5 years.
0: https://www.pnas.org/doi/10.1073/pnas.1919012117
Edit: I've never had a comment so heavily downvoted so quickly. I know it's not the done thing to complain but HN really feels more and more like a boys club sometimes. Could anyone explain what they find so contentieus about what I've said?
Re: AI models miss disease in Black and female patients
#8What's so striking is how strongly race shows in X-rays. That's unexpected.
Re: AI models miss disease in Black and female patients
#9just giving globs of training sets and letting a process cook for a few months is just going to be seen as lazy in the near future
more specialization of models is necessary, now that there is awareness
Re: AI models miss disease in Black and female patients
#10This seems like a problem that should be worked on It also seems like we shouldn't let it prevent all AI deployment in the interim. It is better that we take the disease detection rate for part of the population up a few percent than we do not. Plus it's not like doctors or radiologists always diagnose at perfectly equal accuracy across all populations. Let's not let the perfect become the enemy of the good.
[flagged]