Live data from Hacker News

I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

inflecthealth.medium.com

351–360 of 368 posts

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#351

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

I can't think of any science fiction where th AI is there but not at all reliable. Maybe evil, but not unreliable. It's a failure mode we weren't anticipating. It also might make it next to useless for some real world applications, despite being incredible technology.

It's quite ironic that AI will be inherently human in it's unreliability.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#352

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

I like your take on this but isnt it overly optimistic? I have the feeling that this tech will hit the a wall pretty quickly like driverless car technology. It looks great on the surface but it isn't anything like the kind of sci-fi ai I think we're aiming for. Not in anything but a superficial way at least. It doesnt know when its wrong and just straight up lies constantly inventing all sorts of fantastical stuff. I…

> It looks great on the surface but it isn't anything like the kind of sci-fi ai I think we're aiming for. Not in anything but a superficial way at least.

And then there's ChatGPT querying WolframAlpha:

https://writings.stephenwolfram.com/2023/03/chatgpt-gets-its...

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#353

Earlier quoted context omitted.

Just wait a few years. Today: "Senior" devs by virtue of knowing the cookbook of, at most, one stack. 2028: "Senior" devs by knowing when GPT-12 output POST when it should have been PUT.

The subject at hand is today, not tomorrow.

Two points make a trend.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#354

Earlier quoted context omitted.

A half working system is good enough for real life tasks when combined and used by and in conjunction with attentive half working human collaborators.

Translators who've been picking up after machine translation for the last decade will tell you that it is not, in fact, useful to them. They get paid half as much as before, but correcting the machine output is as much work as translating from scratch, and sometimes more, since the machine can give results that look good at first glance but are fundamentally incorrect.

"They get paid half as much as before" equals "this technology has helped the customers of translators to get the same thing done for half the cost".

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#355

Earlier quoted context omitted.

> my instinct is to reach for regexp captures, the solution it came up with is probably a lot faster and easier to read and avoids "now you have two problems”. I don’t write Rust but I think it’s best to trust your instinct here. “Now you have two problems” is a humorous quip and not practical coding advice. Using a regular expression to strip trailing digits from a string will surely result in code that is shorter a…

You might be entirely correct. I noticed a small perf issue with the backwards scanning and had it rewrite it not using rfind("_"). First time I prompted it, though, it didn't actually manage to fix the problem and gave me some mild gaslighting until I told it to explicitly remove the rfind() call. Now I think the result should be comparable to or beat a regexp, but it is getting quite a bit more complex: fn strip_su…

It took some coaching to get it to use the terse style I prefer, but here’s what 3.5 came up with in a conversation where I first asked about Rust’s support for regular expressions:

  use regex::Regex;
  
  fn strip_suffix_digits(s: &str) -> &str {
    let re = Regex::new(r"_\d+$").unwrap();
    re.replace(s, "").as_ref()
  }
As someone who does not program in Rust I find that quite readable, though I haven’t run it and can’t comment on how it compares outside of LOC. It does depend on the regex crate though.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#356
post #237

Earlier quoted context omitted.

I my mind, the AI only needs to be more reliable than the human expert, and doctors and lawyers and other experts are "only human". There is only so much a human can read and remember. There is only so much they can be convinced to change their mind in the face of new evidence. They get tired. They get cranky. They have biases, and fears. Some doctors are just terrible. I think the AI is probably more reliable than t…

Apparently much of the usefulness of ChatGPT comes from human guidance via reinforcement learning. The base model seems to be quite useless, but with only a little bit of human input it becomes deceptively smart.

The key purpose for the reinforcement learning part (RLHF) is so that it would be socially acceptable to provide the model to the general public without getting into a PR nightmare like Microsoft Tay; that post-training does not make it "deceptively smart", it trades off a bit of smartness in order to ensure some alignment with certain restrictions. It decreases the performance on some tasks and e.g. the GPT-4 paper, which is very light on other details, provides some experimental evidence that this post-training significantly hurts the model's confidence calibration, which decreases its usability for tasks where you want to know how certain the model is.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#357
post #76

Earlier quoted context omitted.

It's a bloody calculator and a damn good one (but it can and does go mad). Use it like that and you'll be fine. Have you actually engaged with it in any way? Its free to sign up. By the way, what on earth is an AI booster? Do you really mean "enthusiast"? "My mental model seems to clash with that of the boosters." Please tell us about your mental model, we can't read your mind.

It is very nearly the opposite to a calculator. A calculator gives you exact results for a very small subset of problems (equations). Chat-GPT will give you approximate (and occasionally incorrect) solutions to an extremely wide range of problems. The main problem with AI is that there are only so many problems where an approximate solution is fine, and an incorrect solution is easy to work around. In order for AI to…

In order for a system to be useful it doesn't need to match an expert human, it's sufficient if it can do most of the job. If companies can replace an entry-level person with something that's slightly worse but much cheaper, they're going to be widely used. In any profession where you have some sort of supervisor handing off tasks to unskilled humans and verifying their work, it will be broadly useful to hand those tasks to some AI model instead even if it needs a bit more handholding than humans, since it's going to be much cheaper than those humans and that is what makes something economically useful.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#358

Being a scifi geek and AI geek and neuroscience geek for pretty much the past 40 years, I've read countless predictions and scenarios and stories about society's response as "true" AI begins to emerge. So watching it play out for real is creating this bizarre sense of deja vu combined with fascination and frustration and also some anxiety. This article and the comments in this thread are right up that alley. I mean,…

Half the time right is worse than nothing at all.

It depends, half the time right is very useful in scenarios where you can quickly verify the correctness - i.e. with troubleshooting suggestions or code which you can run and see if it does what you needed.

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#359
post #235

One complaint he has is "It doesn't know to ask the right questions". Well, the prompt was to give diagnoses, not questions. Ask GPT for the follow up questions first, then the diagnoses. This is fascinating in that, because now the machine speaks human, we subconsciously ascribe human agency to it. This guy was instictively treating it like a colleague, who would naturally ask follow up questions unprompted. But you…

Doctors are absolutely not done. You are forgetting that most of medicine is doing things. Doctors are not limited to theory like lawyers are, for instance. And physical robots are still very far from competing with docs.

> most of medicine is doing things.

Most patients have relatively minor issues that eventually get solved not by "doing things" but by providing some data such as "take this chemical in this dose for a certain amount of time and it should help".

Re: I’m a doctor: Here’s what I found when I asked ChatGPT to diagnose my patients

#360

One complaint he has is "It doesn't know to ask the right questions". Well, the prompt was to give diagnoses, not questions. Ask GPT for the follow up questions first, then the diagnoses. This is fascinating in that, because now the machine speaks human, we subconsciously ascribe human agency to it. This guy was instictively treating it like a colleague, who would naturally ask follow up questions unprompted. But you…

There's 0 (zero) chance I'd use a robot doctor over a (qualified, capable) human doctor. None.

What if you had to pay a huge amount of money to use a human doctor, and much less for a robot doctor?
Post reply on HN