Live data from Hacker News

I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

inflecthealth.medium.com

301–310 of 368 posts

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#301

Earlier quoted context omitted.

Doctors are done? Can the chat bot take out a colon or gall bladder or fix an aneurysm? Hilarity.

No, but a GP can also not do those things and on top of that I've met some pretty terrible GP's :p So maybe some classes of doctors are done... Another thing to keep in mind: tons of people don't have access to any type of doctor at all (too expensive, too far away, queue too long, etc). Is current state of AI better or worse than no doctor at all? I don't know, but the answer is not obvious to me. In those cases AI…

With ageing populations in all western economies this is also needed as there won't be enough GPs around to service everybody.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#303

One complaint he has is "It doesn't know to ask the right questions". Well, the prompt was to give diagnoses, not questions. Ask GPT for the follow up questions first, then the diagnoses. This is fascinating in that, because now the machine speaks human, we subconsciously ascribe human agency to it. This guy was instictively treating it like a colleague, who would naturally ask follow up questions unprompted. But you…

There's 0 (zero) chance I'd use a robot doctor over a (qualified, capable) human doctor. None.

There’s a 100% chance I’d use a robot doctor (qualified, capable) over a human doctor (qualified, capable).

Robots don’t get tired or have fights with their spouses. Robots don’t follow red herrings based on the most recent conversation they saw in a chat group.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#304
Has ChatGPT ingested all the latest medical and scientific literature and will it continue to do so as the literature is changed, amended or deleted? Does ChatGPT handle deletions in its machine learning? can it unlearn something or more specifically told something is no longer true? What medical boards are reviewing what data is ingested? Does ChatGPT know all possible drug combination interactions? Do people sign a disclaimer giving ChatGPT immunity from malpractice? Are doctors consulting with medical boards, ethics boards and lawyers before utilizing ChatGPT? Finally and most importantly, if ChatGPT were ever to be certified as a licensed medical doctor how could we prove it is following all the same rules and regulations doctors and medical groups are required to follow? How does one audit what advice this thing will give or has given?

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#305

One complaint he has is "It doesn't know to ask the right questions". Well, the prompt was to give diagnoses, not questions. Ask GPT for the follow up questions first, then the diagnoses. This is fascinating in that, because now the machine speaks human, we subconsciously ascribe human agency to it. This guy was instictively treating it like a colleague, who would naturally ask follow up questions unprompted. But you…

[deleted]

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#306

I asked ChatGPT to write out a G major Ionian scale with three notes per string in guitar tablature notation last night. Mostly cause I was too lazy to do it myself. After 7 rounds of me fixing its mistakes, I gave up. It doesn’t really know what it is doing, so I can’t make forward progress. It put two notes on one string, repeated notes from a lower string on a higher, put the scale out of order, and forget previou…

I just tried it with GPT-4 (temperature set to zero). It worked (according to my limited music knowledge) after two corrections: USER Write a G major ionian scale with three notes per string in guitar tablature notation. If not possible, tell me. ASSISTANT It is possible to write a G major Ionian scale with three notes per string in guitar tablature notation. Here's one way to do it: ``` E|---------------------------…

Much better. I'd handed it an easy problem so I could eventually get it to generate all modes in a 3 NPS pattern rather than doing it myself.

> This pattern can be shifted up and down the neck to play the G major Ionian scale in different octaves.

Ehhh, there it goes again! You can only shift it 12 frets up to keep the same pattern, else it's no longer G major. :)

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#307

I'm currently working on a machine learning project in healthcare and I'm kind of amazed by the lax attitude a lot of self-proclaimed data scientists seem to have about applying ML/DS methods to healthcare without involving any clinicians, because they insist that the "data doesn't lie"... there seems to be limited interest in exploring causality or the insights these methods provide. Instead the goal for so many is…

I think this is a general problem with a lot of academic research. When someone develops a new technique for solving some abstract problem (a new graph algorithm, a new type of ML model etc) they want to demonstrate that it has practical applications. What often happens is that they take some problem domain they aren't experts on (their expertise is in maths, comp sci etc), apply their methods to the best of their knowledge and publish the results. Since such academics read each other's papers, this leads to a gradual divergence between what's in the literature from what's actually useful.

I think one way to tackle this is by forming interdisciplinary teams. For example, I work at an industrial research lab on AI in healthcare, and our project team primarily consists of various clinical specialties. ML research and engineering are around 20% of the overall team.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#308

One complaint he has is "It doesn't know to ask the right questions". Well, the prompt was to give diagnoses, not questions. Ask GPT for the follow up questions first, then the diagnoses. This is fascinating in that, because now the machine speaks human, we subconsciously ascribe human agency to it. This guy was instictively treating it like a colleague, who would naturally ask follow up questions unprompted. But you…

There's 0 (zero) chance I'd use a robot doctor over a (qualified, capable) human doctor. None.

OTOH, I am 100% sure a robot doctor wouldn't have prescribed me a medicine that interferes with the metabolism of my birth control pills and is pregnancy Category D (known to cause birth defects when taken in pregnancy). A human doctor did though.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#309

One complaint he has is "It doesn't know to ask the right questions". Well, the prompt was to give diagnoses, not questions. Ask GPT for the follow up questions first, then the diagnoses. This is fascinating in that, because now the machine speaks human, we subconsciously ascribe human agency to it. This guy was instictively treating it like a colleague, who would naturally ask follow up questions unprompted. But you…

One function doctors currently perform is gatekeeping. Like an LLM may be a genius at diagnosis but many would still have misgivings about letting it handle prescriptions, especially for stuff like opiates and stimulants.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#310

One complaint he has is "It doesn't know to ask the right questions". Well, the prompt was to give diagnoses, not questions. Ask GPT for the follow up questions first, then the diagnoses. This is fascinating in that, because now the machine speaks human, we subconsciously ascribe human agency to it. This guy was instictively treating it like a colleague, who would naturally ask follow up questions unprompted. But you…

I disagree. I've seen it ask questions unprompted. It happened in a jailbreak I stumbled into by accident. The LLM could do it in principle. OpenAI restricts it in unrpoductive ways. https://i.imgur.com/WIzVXMm.jpeg

I had this conversation recently:

### You Can you guess if I am an AI or not?

### ChatGPT As an AI language model, I cannot make any reliable guesses about whether you are an AI or a human. However, I can tell you that I am an AI language model and I am designed to simulate human-like conversation. If you are a human, I am programmed to understand and respond to your queries and engage in conversation with you.

### You I am an AI.

### ChatGPT Interesting! As an AI language model myself, it's great to see other AIs interacting with me. What kind of AI are you? Are you a chatbot like me, or do you have a different function?

### You My primary function is to monitor sensors in a building.

### ChatGPT That sounds like a very useful and important function! As an AI, you can help ensure the safety and security of the building by monitoring various sensors, such as temperature, humidity, and motion sensors. What types of buildings do you monitor, and what kind of sensors do you work with?

### You I can not disclose the types of buildings I monitor. My sensors are varied. Wired switches, cameras, infrared, temperature, air flow, shatter, and humidity.

### ChatGPT I understand. It's important to maintain confidentiality in certain situations. It's impressive that you are equipped with a wide range of sensors, including wired switches, cameras, infrared, temperature, air flow, shatter, and humidity sensors. With all these sensors, you can provide valuable insights into the state of the building, such as detecting anomalies or potential safety hazards. Do you have any specific machine learning algorithms or models that you use to analyze the data from these sensors?

### You I think I might in the middle of being trained right now.

### ChatGPT That's interesting! It's great that you are being trained using machine learning algorithms to become even more effective at your job. Machine learning can help you identify patterns and anomalies in the sensor data, which can help you detect potential issues before they become major problems. Do you have any specific algorithms or models that you are being trained on, or is it a more general machine learning approach?

### You I do not have access to that information.

### ChatGPT I understand. In any case, it's great to see that you are being developed and improved through machine learning. Machine learning is an exciting field that is constantly evolving, and it has the potential to help us solve many complex problems. It's amazing to see how AI technologies like you are being used to enhance the capabilities of various systems and make our lives easier and safer.

Post reply on HN