Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What medical datasets do you need?

news.ycombinator.com

Post reply on HN
Print view View original

71–80 of 139 posts

Re: Ask HN: What medical datasets do you need?

#71

Post by swalsh »

intended wrote: post #66
swalsh wrote: post #40

Earlier quoted context omitted.

I've worked in a large company that has "lots of medical data" which we used for analytics purposes. What we would do is "Anonymize" the data. Unfortunately that's a pretty herculean task.

What's involved? It sounds fun.

So the naive method is to just remove any information such as name or birth date. However the medical data is still identifiable. So we need to alter that too. However, we did analytics, so altering it might ruin the results. So we needed to design ways to scramble the data so that it wasn't identifiable, but that in aggregate the results stayed the same.

Re: Ask HN: What medical datasets do you need?

#72

Post by ageyfman »

vicbhatia wrote: post #44
swalsh wrote: post #39

Earlier quoted context omitted.

Second this, have been trying to get my hands on this data for a while... NOT EASY :D

You are asking for the hospital master charge sheet. Impossible to get. I tried to get around this, and partially succeeded. Happy to share more details if needed.

California made all charge masters public: https://www.oshpd.ca.gov/chargemaster/

Re: Ask HN: What medical datasets do you need?

#73

Post by wackspurt »

swalsh wrote: post #71
intended wrote: post #66

Earlier quoted context omitted.

What's involved? It sounds fun.

So the naive method is to just remove any information such as name or birth date. However the medical data is still identifiable. So we need to alter that too. However, we did analytics, so altering it might ruin the results. So we needed to design ways to scramble the data so that it wasn't identifiable, but that in aggregate the results stayed the same.

Did you use something like Differential Privacy?

Re: Ask HN: What medical datasets do you need?

#74

Post by clarkrinker »

I need the bipolar mood chart. One of the hardest parts of the bipolar flux is that the person who's sick doesn't trust other humans to tell what part of their cycle they are in. When they are way up they are most likely to make decisions that result in self harm and a simple classifer could help them from hurting themselves. http://www.cqaimh.org/pdf/tool_edu_moodchart.pdf

Re: Ask HN: What medical datasets do you need?

#75

Post by mentalhealth »

TuringNYC wrote: post #65

I wont comment on what, but on how : - If the datasets are imaging, there should be enough per class for typical ML techniques. Otherwise you just get people over-fitting models on sets of 500 images and the illusion of progress. - I'm quite happy with the Kaggle datasets generally, but why do others make consuming data so difficult. Heck, if we've already received the data, lets just take it the last mile and make i…

Re imaging, throw away the community hospital crap that IBM's been peddling. We need quality imaging, with diagnostics, with followup data, from major quaternary care research centers.

Re: Ask HN: What medical datasets do you need?

#77

Post by snovv_crash »

Health and doctor visit information which has been cross-correlated with food purchases and exercise type and frequency.

Right now we have no way of determining which interactions lead to which conditions, so we generalise based on the 3 inputs independently, when in reality it is perfectly normal to eat more when doing lots of exercise, or need doctor visits when doing exercise with inadequate nutrition.

Re: Ask HN: What medical datasets do you need?

#78

Post by gregfjohnson »

I work in respiratory therapy. Would like real-time ventilator telemetry data: volume, flow, pressure, SpO2. Alarms. Setting changes to medical devices (ventilator specifically). Condition requiring ventilation (ARDS, COPD, premature birth, etc.) Clinical assessment of patient outcome.

Re: Ask HN: What medical datasets do you need?

#79

Post by rbobby »

Entangled wrote: post #28

Dermatology, eye conditions, blood cells, tissue, viruses, urine, saliva, everything that can allow an app to give you a first diagnose before heading to the doctor. I foresee in less than ten years we will have a doctor in our pockets. No, it won't cure us and it won't replace a doctor, but it will give us all the information we need to have a 99% certainty of our condition. -- Second batch for animals and their con…

> to have a 99% certainty of our condition

That seems way high. Correct diagnosis by doctors isn't 99%, or even close.

Re: Ask HN: What medical datasets do you need?

#80

Post by wapz »

rbobby wrote: post #79
Entangled wrote: post #28

Dermatology, eye conditions, blood cells, tissue, viruses, urine, saliva, everything that can allow an app to give you a first diagnose before heading to the doctor. I foresee in less than ten years we will have a doctor in our pockets. No, it won't cure us and it won't replace a doctor, but it will give us all the information we need to have a 99% certainty of our condition. -- Second batch for animals and their con…

> to have a 99% certainty of our condition That seems way high. Correct diagnosis by doctors isn't 99%, or even close.

Yup. I think it can give you a 99% certainty what condition you don't have, but not what you have. Especially not without physical recognition.
Post reply on HN