Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I used Claude Code to get a second opinion on my MRI

antoine.fi

Post reply on HN
Print view View original

731–740 of 748 posts

Re: I used Claude Code to get a second opinion on my MRI

#731

Post by StefanBatory »

nostrebored wrote: post #701
StefanBatory wrote: post #548

Earlier quoted context omitted.

> I do think that people saying “doctors don’t know the state of the art” have a weaker case. This is kinda the case though. In Poland I met only one psychiatrist that knew about DSM-5. In this year. DSM-5 was a thing from 2013. Doctors are people just as us, not every single of them is good.

Oh I agree with you, it's just that I don't think LLMs are either. If you think of LLM knowledge, especially in scientific/engineering fields, as a lossy representation of the density of ideas, then you'd expect to see some weird behavior. I'm sure there is some sort of a temporal discounting and people thinking about this, but a naive NLL or Reverse-KL on medical literature would engrain some weird, wrong ideas.

I brought down prod system because I was too stupid and relied down on LLM advice, even double checking it.

I would not trust my health to LLMs, that is true.

Re: I used Claude Code to get a second opinion on my MRI

#732

Post by b800h »

weatherlite wrote: post #721
b800h wrote: post #718

Earlier quoted context omitted.

Her nurses frequently couldn't speak English. I had to spell out her medical conditions letter by letter so that the nurse could input it onto the medical system. She was entering gibberish / wrong info until I stepped in, as I was watching the PAS out of interest.

fucking hell. dont they have language tests for foreign nurses? how the hell did she pass it ?

They effectively had tourist English. They're probably in through an agency so the financial incentive is to find an examiner who will give the right answer.

Re: I used Claude Code to get a second opinion on my MRI

#733

Post by Eufrat »

anon84873628 wrote: post #727
Eufrat wrote: post #709

Earlier quoted context omitted.

> It's something computers will be able to do strictly better. I don’t think there’s any evidence that’s true.

Really? What about the use of computer vision for satellite imagery? Facial recognition? The premise seems to be proven, just not extended to the medical domain yet.

I think you’re conflating detection with interpretation.

Re: I used Claude Code to get a second opinion on my MRI

#734

Post by lazide »

brokencode wrote: post #715
lazide wrote: post #711

Earlier quoted context omitted.

No shit Sherlock, of course I’ve seen it. It was my job. This is exhausting. It’s like arguing crypto with someone who has never actually committed a line of code. Why do I even bother?

You’re expecting me to know your job? Give me a break. I’m wondering the same thing. You keep talking of some grand poisoning problem but can’t point to any specific public information except an article saying that it’s possible. As if that was ever in doubt. Guess we’ll just have to agree to disagree.

angry and ignorant! impressive

Re: I used Claude Code to get a second opinion on my MRI

#735

Post by marcus_holmes »

bondarchuk wrote: post #641
marcus_holmes wrote: post #481

Earlier quoted context omitted.

In my day job we tried creating a credit assessor tool using LLM as the credit assessor. It did great, generated a report on the assessed business that was incredibly detailed and plausible. Then I started running tests and getting into the details, and found that if you ran the same report on the same data, it generated completely different, still very plausible, results. I could run the same source data through the…

It's funny that if the LLMs had all given the same result each time (it sounds like) you would have considered it more valid, even though it might just be giving a single wrong answer more consistently.

yeah, it would have been harder to see that the LLM was making shit up if it had consistently made the same shit up. But this is also true of humans, so...

Re: I used Claude Code to get a second opinion on my MRI

#737

Post by anon84873628 »

Eufrat wrote: post #733
anon84873628 wrote: post #727

Earlier quoted context omitted.

Really? What about the use of computer vision for satellite imagery? Facial recognition? The premise seems to be proven, just not extended to the medical domain yet.

I think you’re conflating detection with interpretation.

Radiologists like to distinguish between "perception" and "cognition", but the reality is that cognition is the same statistical process machines use, just without knowing the actual probability numbers.

Satellite image processing can certainly detect a hotspot then interpret it as either a small brushfire or a missile launch. Facial recognition detects my features then interprets who I am. It's all pattern matching just at different scales in different parameter spaces.

Re: I used Claude Code to get a second opinion on my MRI

#738

Post by wwweston »

malfist wrote: post #654
kerabatsos wrote: post #421

Earlier quoted context omitted.

People put a lot of faith in human “guardrails”, standards, etc. But the same argument could be made that trusting human experts without discernment is as dangerous as trusting AI or Google or whatever other non-human source. It’s always been the case.

On the plus side, it's not like it was blind faith. Human judgement lead me to seek out another expert when I didn't like with the current PT was suggesting I do (no practicing hip hinge movements before moving to deadlift, advising against valsava for heavy lifts, ignoring feedback that a movement was causing pain, prescribing stretches to increase flexibility in a hypermobile person). The LLM also gave me a bunch o…

FYI - if there's any reason to believe your particular hypermobility issues might be rooted in any kind of named or unnamed connective tissue disorder, be sure to familiarize yourself with the potential vascular hazards of heavy lifts in general and Valsalva breath-holding specifically. Hypermobility can be a sign that you've drawn a genetic lot which means that you don't even have to lift all that heavy to create aneurysms.

And in keeping with our theme of the limits of both LLMs and humans, unfortunately many exercise and medical professionals may not focus on how some specific genetic lots work until a catastrophic problem presents itself.

> ignoring feedback that a movement was causing pain, prescribing stretches to increase flexibility in a hypermobile person

So glad you found better advice than this!

LLMs are fantastic tools for exploring a topic, coming up with good questions and lines of understanding to pursue with professionals, and in picking professionals. I think they're also poor outright replacements for people especially when it comes to deep and important domains, but still quite useful.

Re: I used Claude Code to get a second opinion on my MRI

#739

Post by [deleted] »

CyberDildonics wrote: post #664
YeGoblynQueenne wrote: post #377

Earlier quoted context omitted.

If you think you have it, then you don't. If you have it, you won't think, you'll know. Spoiler: because it hurts like hell.

That doesn't make any sense, it would imply that anything that hurts would automatically be the same diagnosis. Both inductive and abductive reasoning would say that just because something hurts that doesn't mean that everything that hurts is that thing.

[deleted]

Re: I used Claude Code to get a second opinion on my MRI

#740

Post by coderatlarge »

ShinyLeftPad wrote: post #699
coderatlarge wrote: post #673

Earlier quoted context omitted.

surely getting the same answer multiple ways suggests it is nore likely in the probability space?

Slavery used to be super likely in the probability space, doesn't make it right...

if two llms independently cite the same law given a certain factual legal question then it generally makes it more likely that the law cited does, in fact, apply to the fact pattern in question ; i think you’re using “right” in a moral sense irrelevant to the comment i was responding to.
Post reply on HN