Live data from Hacker News

Show HN: Explore doctors' disciplinary history

physician.fyi

31–40 of 66 posts

Re: Show HN: Explore doctors' disciplinary history

#31
post #27

Note: California ONLY. (commment: pity all states don't publish this in machine-readable formats. Id say this is more important than the monthly food report in the nnewspaper.)

From the other comments it doesn't look like the data source is machine readable. It looks like there's automated OCR of PDFs. A similar project was doing the same but with human labor

Re: Show HN: Explore doctors' disciplinary history

#32

Thank you for this. The medical industry is in dire need of transparency. Next up would be pricing and costs!

There is movement on the price/cost front. I found one tool that provides this data in a more searchable way (turquoise.health) and used it with limited success. I believe the upstream data is public as well, but cant remember the name of the repository OTOH.

Re: Show HN: Explore doctors' disciplinary history

#33

That's a really interesting project ! One pet peeve, though. Some entries have "Arbitration Award" listed as an action. However, these usually mean that the physician won an arbitration case (i.e. the ruling was in their favour). Listing them without any differentiation can potentially negatively bias a person's opinion against a perfectly honest doctor.

Thank you. Here [1] is the source for one, which states "An arbitration award is a payment for damages and does not necessarily reflect that the physician's medical competence is below the standard of care. The Medical Board reviews all such reported arbitration awards and action is taken only if it is determined that a violation of the Medical Practice Act occurred. The Medical Board is prohibited by law from releasing a copy of the arbitration award report or any other information concerning the award." I am still unsure if that means the award was in the doctor's or patient's favor, and because the report is secret, it may not be possible to find out, but please let me know if you know how I could find out.

I also want to mention that patients are forced into arbitration via the contract for service they initially sign [2] that many don't read (whether due their inability to understand it or time constraints on needing immediate care and limited availability of doctors). However, I think it's a shady practice that hurts patients [3] and it would be worth keeping the data showing doctors taking advantage of it regardless. The main excerpt from the article supporting my thoughts is "Doctors’ attorneys are more likely to develop relationships with the arbitrators, they say, who, in turn, may give the plaintiff only a token award to get continued business from doctors."

[1] https://search.dca.ca.gov/details/8002/G/77959/9df8d122bd5b5...

[2] https://law.justia.com/codes/california/2007/ccp/1295.html

[3] https://www.latimes.com/archives/la-xpm-2000-apr-24-he-22804...

Re: Show HN: Explore doctors' disciplinary history

#34

I just read one of these via your site at random. Holy crap, talk about incompetence! https://web.archive.org/web/0/https://www2.mbc.ca.gov/PDL/do...

Here's a quote from one I randomly clicked on: >Respondent admits that there were billings for 35 treatments apiece for two undercover law enforcement officers when each had only five visits. Further, he acknowledged that had he known the true facts, he would have investigated further. However, had he been vigilant, respondent does not believe that he would have detected the problem because patient signatures, as evi…

I've read some others with undercover agents when federal money is involved in the care like the patient using Medicaid and the doctor repeatedly uses that as a ticket for billing unnecessary services.

Re: Show HN: Explore doctors' disciplinary history

#35

This is great to see. Some feedback: I entered the exact name of a doctor I knew would be in the database, formatted as "firstName lastName". The result was buried under 20 other less relevant matches. I had to search as "lastName, firstName", for it to come back as the first result.

Thank you. I'll fix asap. The data source only gives me the names as complete names in "last, first middle" format, and I didn't want to take risk parsing them since there are inconsistencies, but I'll work it out. For now, I've clarified the format in the placeholder of that field.

Re: Show HN: Explore doctors' disciplinary history

#36
post #24

This is great to see. Some feedback: I entered the exact name of a doctor I knew would be in the database, formatted as "firstName lastName". The result was buried under 20 other less relevant matches. I had to search as "lastName, firstName", for it to come back as the first result.

I noticed when zooming in on the map, the light blue color is almost identical to what the map shows as lakes/ponds/water etc.

Thank you. I'll fix this. I'm working out dark mode for the map, so I'll do it along with that when I figure it out.

Re: Show HN: Explore doctors' disciplinary history

#38

Two bug reports: 1. When I search by "Malpractice Settlements", I get a "Minified React error #31" on every result I click on. 2. You're doing something horrible with the back button - I clicked on one result and had to click the back button 10 times to get out of your site.

Thank you.

1. Fixed

2. Do you think this is because the URL stores the filter params, so every time you change a filter it's a new address? Do you have any examples of similar sites and how they behave? I can change this if it's not standard.

Re: Show HN: Explore doctors' disciplinary history

#39
post #4

Excellent, thank you for creating this. Just learning that this data is available. Only California? Are the other states not making the data available in the same fashion as CA? Also, was there a personal trigger for you to create this?

Thank you. This data should be available in all states, but each state has a proprietary site I have to write a new scraper for and write a new data pipeline for. I'm thinking about open-sourcing the project and gathering community support for the rest now that I have a good pattern set. Yes, I was harmed by a doctor and the medical board dismissed my complaint. This made me curious about what the board actually does…

Open sourcing this would be a great idea and a lot of people would happily contribute, it already looks great. The biggest secret is that most doctors do more harm than good when a patient has anything worse than a cold. The psychopaths who couldn't make it as CEOs or serial killers end up becoming doctors, in charge of people's health.

Re: Show HN: Explore doctors' disciplinary history

#40
post #9
post #4

Earlier quoted context omitted.

Thank you. This data should be available in all states, but each state has a proprietary site I have to write a new scraper for and write a new data pipeline for. I'm thinking about open-sourcing the project and gathering community support for the rest now that I have a good pattern set. Yes, I was harmed by a doctor and the medical board dismissed my complaint. This made me curious about what the board actually does…

> I archived every PDF available on the wayback machine How did you tell archive.org to store the PDFs? It doesn't seem to have worked in all cases, since when I went to check out the single "order vacating automatic cancellation of certificate", there was no snapshot yet. https://web.archive.org/web/20231009140931/https://www2.mbc....

I have to admit I missed a few hundred out of about 18k PDFs. I didn't keep track of which ones I archived on my initial pass, so I need to rerun the whole script which takes about a week with Web Archive's rate limit, so I've just been putting it off. I was also thinking people who visit them can click the "archive" button in cases it's not yet archived to crowdsource the effort, like you seem to have done.
Post reply on HN