Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Using GPT-3 and Whisper to save doctors’ time

news.ycombinator.com

Post reply on HN
Print view View original

61–70 of 141 posts

Re: Show HN: Using GPT-3 and Whisper to save doctors’ time

#61

Post by D13Fd »

swatcoder wrote: post #43

I don't spend much time worrying about AI ethics, but bringing AI close to patient interactions and record-keeping in healthcare seems grossly premature and irresponsible. There are countless brilliant applications of AI and the last one we need is a mediocre automated transcriptionist that distances a doctor from their responsibility to engage with the patient and can bear no accountability for error. This is a task…

The transcription part doesn't bother me. That's just advanced speech-to-text.

The summarization part, though, is dangerous. It's a very quick path to us losing all faith in our own medical records. Any way you slice it, no matter how much you train it, it's still going to be vulnerable to hallucination errors that slip by the reviewing doctor and become part of the patient's medical history.

Re: Show HN: Using GPT-3 and Whisper to save doctors’ time

#62

Post by D13Fd »

sp332 wrote: post #53
priyanmuthu wrote: post #10

My worry is verification of facts. What if the model summarized incorrect facts, and it gets added to the medical history? How can doctors easily verify and fix things?

It’s easier to revise than to write a first draft. It’s possible to miss mistakes on review, but relatively, I think it’s more likely that a distracted human will mess something up on the first draft.

That's exactly the thought process that leads to us trusting LLMs in places where they shouldn't be trusted.

Re: Show HN: Using GPT-3 and Whisper to save doctors’ time

#63

Post by D13Fd »

The "feed it to a heavily trained GPT-3" part is backwards. The transcribed notes should be stored and retained. The LLM should be applied later, in real time, when someone is referring back to the notes.

That way you still get the benefit of summaries, without polluting the medical records with hallucinated AI nonsense.

Re: Show HN: Using GPT-3 and Whisper to save doctors’ time

#64

Post by ceejayoz »

CuriouslyC wrote: post #57
avgDev wrote: post #34

Earlier quoted context omitted.

If my doctor is googling he is doing his job. He has medical knowledge which allows him to sort through information. Any developer who doesn't google today is hindering his ability to develop and slowing the development process. Just like the dev cannot hold all the algorithms and language caveats/syntax in his head, a physician cannot hold all the information in his brain. He may not be familiar with symptoms or mig…

I would find it suspect if my specialist was googling unless I had something really weird going on, and might consider going to a different specialist.

If they're a neurologist and Googling "what does brain do", sure.

If they're searching up safety data on a slightly-over-recommended dose for a particular medication (like, say, a gastric bypass patient who takes an oral med that's not absorbed as much as in a person with a normal stomach), I'd much prefer they be certain than guess.

Re: Show HN: Using GPT-3 and Whisper to save doctors’ time

#66

Post by ar7hur »

v4dok wrote: post #4

I like the idea, but I would like it even more if it was on-prem. The doctors (at least in EU) will be very wary of having their client meeting essentially recorded by a third party. With this as a cloud SaaS, patient confidentiality is essentially broken since the raw data is available to you while you transcribe it. I understand that you compete with "google speech-to-text" but this is not a feature meant to be use…

Thanks for your comment.

We plan to offer an on-prem option eventually.

In the meantime: - we offer a GDPR compliant EU-based hosting option - we don't store anything (no audio, no transcript, no note): it's stateless and all erased at the end of each consultation - data is pseudonomyzed as it flows though our systems

Our first customers (large healthcare orgs) have been OK with this so far!

Re: Show HN: Using GPT-3 and Whisper to save doctors’ time

#68

Post by soco »

matsemann wrote: post #21
orcajerk wrote: post #6

Last time I went to the doctor, he charged me $300 to google symptoms on a computer. Now you're saying I get to pay $300 for him to ask ChatGPT? No thanks. We all know that is where this is going - doctor decision support system, i.e. the AI has access to information locked behind expensive journals that the patient does not.

Last time I asked a developer to fix a bug, he charged me $300 to google the api docs..! But this isn't even about the doctor asking GPT, this is transcribing the video call so the journaling becomes easier and the doctor can spend more time with their patients. A good thing, no?

No. The transcription part is done by Whisper. After that, GPT summarizes a clinical note which may be truthful - or may have hallucinations just as well.

Re: Show HN: Using GPT-3 and Whisper to save doctors’ time

#69

Post by ar7hur »

swatcoder wrote: post #43

I don't spend much time worrying about AI ethics, but bringing AI close to patient interactions and record-keeping in healthcare seems grossly premature and irresponsible. There are countless brilliant applications of AI and the last one we need is a mediocre automated transcriptionist that distances a doctor from their responsibility to engage with the patient and can bear no accountability for error. This is a task…

I understand your concerns. Our objectives are, on the contrary, to reduce the doctor/patient distance that was created by EHRs and all the required administrative processes. We already measure that when AI takes care of this stuff, doctors do better engage with patients.

Re: Show HN: Using GPT-3 and Whisper to save doctors’ time

#70

Post by norgie »

Is Whisper really up to this? When I've used it, it's...fine. But it also randomly dreams up weird transcriptions that have nothing to do with what's actually being said, and with perfect audio too. Like the audio will be a presentation at a tech conference, and Whisper will predict "check out our site at randomlink.com", when no one said anything close to that.

I'd be pretty concerned if my doctor relied on this to be honest.

Post reply on HN