>If my patient in this case had done that, ChatGPT’s response could have killed her.
Not if she lived in a state where there's no longer any legal treatment for ectopic pregnancy.
I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
81–90 of 368 posts
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#82I think this doctor is forgetting about the other side of the coin... would chatgpt perform better than a really bad doctor?
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#83Earlier quoted context omitted.
What I didn't predict is so many AI boosters being so miffed at regular folks pointing out the obvious: a half-working system may be tremendously exciting to AI enthusiasts, but it's not that useful to society. Recently we've had all these people complaining of moving goalposts, when in fact most people never had goalposts for AI in the first place, and certainly never had goalposts that remotely resembled those that…
It's a bloody calculator and a damn good one (but it can and does go mad). Use it like that and you'll be fine. Have you actually engaged with it in any way? Its free to sign up. By the way, what on earth is an AI booster? Do you really mean "enthusiast"? "My mental model seems to clash with that of the boosters." Please tell us about your mental model, we can't read your mind.
It is very nearly the opposite to a calculator.
A calculator gives you exact results for a very small subset of problems (equations).
Chat-GPT will give you approximate (and occasionally incorrect) solutions to an extremely wide range of problems.
The main problem with AI is that there are only so many problems where an approximate solution is fine, and an incorrect solution is easy to work around. In order for AI to be broadly useful, it has to get to the point where it's correct more often than an expert human. It may well get there within the next couple of years, but this isn't a space LLMs are designed to be able to solve so it's not as guaranteed as a lot of people seem to think.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#84I'm not really sure what he expected here, ChatGPT was not trained to be a doctor, it is far more general than that. Asking ChatGPT for medical advice is like asking someone who is very well read but has no experience as a doctor, and in that context it's doing very well. He also brings up one of the most salient points without really visiting it enough: ChatGPT does not ask for clarification, because it is not a kno…
> I'm not really sure what he expected here, ChatGPT was not trained to be a doctor, it is far more general than that.
Except that O̶p̶e̶n̶AI.com and many others on the AI hype brigade were showing ChatGPT and GPT-4 to be passing "Medical Licensing Exams" with flying colours and it turns out to be a confident bullshitter offering dangerous untrustworthy medical advice when tested by a medical professional as I said before [0].
So they (O̶p̶e̶n̶AI.com and AI bros) set those high expectations from the start.
> As soon as we have agents that can do a proper feedback loop of querying a LLM consecutively until some heuristic is reached then the kind of AI doctors are looking for will emerge.
No.
A black-box neural network AI model that is unable to transparently explain and reason about its own decisions is fundamental to the trust element that medical professionals are looking for. It is more than just spitting out numbers from a computer.
This doctor is also the one still reviewing the so-called 'diagnosis' from ChatGPT which without him, ChatGPT alone would have certainly killed the patient. The human doctor also gave a transparent explanation about why ChatGPT's 'diagnosis' was incredibly wrong. ChatGPT was confident that it was still right.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#85Earlier quoted context omitted.
ChatGPT's heuristic may lead it to emit a sequence of words that suggest to English speakers that they should provide clarification, but ChatGPT is congenitally incapable of determining that answering a question requires more information that was provided in the prompt and that clarification is needed. Rephrased, ChatGPT can ask for clarification, but only as a side effect of satisfying it's heuristic.
> but ChatGPT is congenitally incapable of determining that answering a question requires more information that was provided in the prompt and that clarification is needed. What's stopping the ChatGPT heuristic / model from determining that? That's within the capabilities of a statistical model.
I would say that ChatGPT like systems could probably be built that would understand when they need more context, but they would fail at effectively eliciting that context from their human users.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#86I asked ChatGPT to write out a G major Ionian scale with three notes per string in guitar tablature notation last night. Mostly cause I was too lazy to do it myself.
After 7 rounds of me fixing its mistakes, I gave up. It doesn’t really know what it is doing, so I can’t make forward progress. It put two notes on one string, repeated notes from a lower string on a higher, put the scale out of order, and forget previous corrections. Whatever hope I had of saving time was completely lost.
I eventually realized the correct thing to do was either make my own charts or just practice them in F like they were made.
I’m skeptical that scaling the model up will cause it to learn this, and I don’t consider this a very complex thing to learn. No, I didn’t try GPT4.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#87To me this just reinforces the notion that if you train a system like this to be a doctor it would be very effective.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#88I'm not really sure what he expected here, ChatGPT was not trained to be a doctor, it is far more general than that. Asking ChatGPT for medical advice is like asking someone who is very well read but has no experience as a doctor, and in that context it's doing very well. He also brings up one of the most salient points without really visiting it enough: ChatGPT does not ask for clarification, because it is not a kno…
My hunch is that this is exactly what he was expecting. There is a lot of hype around ChatGPT passing the medical exam and this exercise is a counter point to that.
GPT-4 passed the medical exam, not ChatGPT running GPT-3. There's a rather significant difference.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#89It's amazing that it was that effective... - It's a generalized language model; imagine how much more effective it would be with a specialized ai that used a variety of techniques that are better suited for logic and reasoning, while using llms to interact with patients. - It cost an order of magnitude less than the visit to a doctor. - The potential in being able to constantly monitor a patient - a point made in the…
I imagine development and training of these mythical non-LLM approaches are now placed on the backburner while the world is collectively enamored with eloquent virtual assistants inside microwaves and calculator apps.
Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients
#90I'm not really sure what he expected here, ChatGPT was not trained to be a doctor, it is far more general than that. Asking ChatGPT for medical advice is like asking someone who is very well read but has no experience as a doctor, and in that context it's doing very well. He also brings up one of the most salient points without really visiting it enough: ChatGPT does not ask for clarification, because it is not a kno…
"I'm not really sure what he expected here, ChatGPT ..."
Doctoring is quite similar to ITing if you are careful with your similes. In medicals you look for indications and contraindications. In IT you look for magic beans and sometimes look at logfiles.
I have no idea why we (IT) don't follow the medical way and have indications and contras (I do). They have been doing complicated diagnostics way longer than we have.
BTW: It doesn't worry about a char but about which word will come next.
ChatGPT has written several programs for me. One of them was decent after much negotiation. The rest needed some changes.
At one point I told it to change language (BASH to Python) for a script and it did. I spend 20 mins fining stuff and cracked on.