Live data from Hacker News

I used Claude Code to get a second opinion on my MRI

antoine.fi

31–40 of 748 posts

Re: I used Claude Code to get a second opinion on my MRI

#31
I would not trust AI on images. But I once had ChatGPT tell me that an MRI report was very likely to be incorrect based on the text, and offered a different diagnosis. Since it was semi insisting, I visited another doctor who made me do a retest. Long story short, ChatGPT was correct.

Again, this is just one single person's experience. So not worth much.

Re: I used Claude Code to get a second opinion on my MRI

#32

I feel like I'm going nuts. There are other commenters saying this is a good practice they've also done for other injuries. You are saying you are an actual radiologist and immediately clock the problems with its advice. I have seen this pattern over and over again. Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading. It is only when you do not know wha…

Seems natural enough. There will always be complexity and nuance that is missed by an AI model or person - the world is just super detailed. The more expertise you have the more you will be aware of that nuance. That doesn't mean the model or person is not useful as a starting point.

Re: I used Claude Code to get a second opinion on my MRI

#33

I feel like I'm going nuts. There are other commenters saying this is a good practice they've also done for other injuries. You are saying you are an actual radiologist and immediately clock the problems with its advice. I have seen this pattern over and over again. Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading. It is only when you do not know wha…

> Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading

Yes, this is exactly so. AI is able to confidently sound plausible enough to convince laypersons or anyone who isn't very familiar with the subject matter, which is a big part of the mass-appeal "magic" of ChatGPT and other similar tools. It's like having a know-it-all friend (who also makes shit up to bridge their own knowledge gaps).

In many non-advanced non-specialized situations, AI is right enough to be at best useful or at worst not harmful (usually landing in the middle somewhere).

But speaking for myself, in areas where I consider myself quite proficient, I can very easily spot the subtle inconsistencies and naive conclusions that AI responses provide, and I have to guide/steer/correct it a lot to get good results when the subject matter is complex enough.

Re: I used Claude Code to get a second opinion on my MRI

#35
post #9

Always worth a share for this scenario. It's not clear if LLMs are capable of doing actual analysis on medical imaging. For details see this article https://futurism.com/artificial-intelligence/frontier-models... > As detailed in a new, yet-to-be-peer-reviewed paper, a team of researchers at Stanford University found that frontier AI models readily generated “detailed image descriptions and elaborate reasoning traces…

But why should I care? If you demonstrated that a model can perform more accurate diagnoses than a doctor, but also it had this strange behavior when no image was presented, why should that deter me from using the model?

Re: I used Claude Code to get a second opinion on my MRI

#36
post #25

Earlier quoted context omitted.

Nightmare because they're always right and the A.I second guessing is always wrong, or because they just don't like to be second guessed?

Nightmare because the AI is just generating a random text that fits the question.

I feel the same when visiting a doctor in Canada. In that 2 minutes I have with they in one appointment per year I hear a standard text.

Re: I used Claude Code to get a second opinion on my MRI

#37

That might be doctors new nightmare: people who second guess everything with AI. Previously it was "google your symptoms".

It can be helpful in your understanding the choices made by asking questions and thus in reassurance, but it requires something most people lack: understanding you are likely wrong since you are just collecting information without understanding it.

Pretty much the like most manager these days, so I understand the frustration of the GPs.

Re: I used Claude Code to get a second opinion on my MRI

#38
post #25

Earlier quoted context omitted.

Nightmare because they're always right and the A.I second guessing is always wrong, or because they just don't like to be second guessed?

Nightmare because the AI is just generating a random text that fits the question.

This is a very peculiar use of the word "random".

Re: I used Claude Code to get a second opinion on my MRI

#39

That might be doctors new nightmare: people who second guess everything with AI. Previously it was "google your symptoms".

I asked a clanker about symptoms I was having. (I'm not an idiot, I was already on my way to hospital, clanker was just to take my mind off symptoms during the drive.) The clanker said I'd be fine, I just needed some rest and OTC meds. The medical staff immediately turfed me to surgery because the same set of symptoms I told the clanker were enough to concern them that I needed emergency surgery. Had I have listened…

Very curious what made you run to the emergency first thing in the morning that an LLM understood as "just normal, take some OTC meds and wait".

Re: I used Claude Code to get a second opinion on my MRI

#40

I feel like I'm going nuts. There are other commenters saying this is a good practice they've also done for other injuries. You are saying you are an actual radiologist and immediately clock the problems with its advice. I have seen this pattern over and over again. Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading. It is only when you do not know wha…

> no one else seems to find this to be quite damning for the AI services being offered, preferring instanced to be wowed by the convenience and speed at which they can be delivered unreviewed and unproven information

"Be wowed by the convenience and speed", or merely "take advantage of the mere availability"? What most people find to be damning about expert advice is that they simply can't get it anywhere, at any cost that they can afford.

Post reply on HN