Live data from Hacker News

I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

inflecthealth.medium.com

31–40 of 368 posts

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#31

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

It's interesting for sure. There's also the fact that he didn't use the sota (GPT-4). I'm not saying that would be perfect. But i would be surprised if it wasn't big leap over 3.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#32

I'm not really sure what he expected here, ChatGPT was not trained to be a doctor, it is far more general than that. Asking ChatGPT for medical advice is like asking someone who is very well read but has no experience as a doctor, and in that context it's doing very well. He also brings up one of the most salient points without really visiting it enough: ChatGPT does not ask for clarification, because it is not a kno…

> ChatGPT does not ask for clarification

It depends on how you use it. Knowing how it works, you can explicitly check "What further questions for the patient would make the diagnosis more certain?"

ChatGPT is not magic - if you ask for diagnosis based on some info, that's exactly what you're going to get.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#33

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

> as "true" AI begins to emerge

What, exactly, is that?

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#34

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

But at the same time consider the problem, and if AI is even the tool for this job or if its total overkill. We are just matching symptoms to a diagnosis, you could get this utility from programming a simple dictionary with a fraction of the compute. Maybe even with a confidence estimate of the diagnosis this time. There's an old adage that rings true here I think: "keep it simple, stupid."

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#35

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

Half the time right is worse than nothing at all.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#36

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

> as "true" AI begins to emerge What, exactly, is that?

Meant AGI

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#37

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

What I didn't predict is so many AI boosters being so miffed at regular folks pointing out the obvious: a half-working system may be tremendously exciting to AI enthusiasts, but it's not that useful to society.

Recently we've had all these people complaining of moving goalposts, when in fact most people never had goalposts for AI in the first place, and certainly never had goalposts that remotely resembled those that AI experts use to evaluate their own progress.

My mental model seems to clash with that of the boosters. They appear to have little doubt that reliability will emerge from scaling the models up. I think reliability is the lion's share of the problem and probably won't be solved by current architectures. It will be interesting to see who is right.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#38

I'm not really sure what he expected here, ChatGPT was not trained to be a doctor, it is far more general than that. Asking ChatGPT for medical advice is like asking someone who is very well read but has no experience as a doctor, and in that context it's doing very well. He also brings up one of the most salient points without really visiting it enough: ChatGPT does not ask for clarification, because it is not a kno…

I don't mean this in any sort of negative context - curating your online presence is a never-ending task - but I believe that the authors primary expectation was to drive traffic to their online accounts by publishing a post on the subject matter. A cursory peek at their accounts show that this was published across all of them with Twitter showing the farthest reach.

> Dr... is vice president of innovation at {company_name}, an innovation incubator for health tech.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#40

I'm not really sure what he expected here, ChatGPT was not trained to be a doctor, it is far more general than that. Asking ChatGPT for medical advice is like asking someone who is very well read but has no experience as a doctor, and in that context it's doing very well. He also brings up one of the most salient points without really visiting it enough: ChatGPT does not ask for clarification, because it is not a kno…

My hunch is that this is exactly what he was expecting. There is a lot of hype around ChatGPT passing the medical exam and this exercise is a counter point to that.

any example that doesn't use the current sota isn't a very good counter point to be honest. 3 barely passed. 4 aced it. For all we know, GPT-4 erases most of his concerns (not saying it would).
Post reply on HN