Live data from Hacker News

I used Claude Code to get a second opinion on my MRI

antoine.fi

271–280 of 748 posts

Re: I used Claude Code to get a second opinion on my MRI

#271

I feel like I'm going nuts. There are other commenters saying this is a good practice they've also done for other injuries. You are saying you are an actual radiologist and immediately clock the problems with its advice. I have seen this pattern over and over again. Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading. It is only when you do not know wha…

> I have seen this pattern over and over again. Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading

AI assistant are industrializing the Gell-Mann amnesia effect.

Re: I used Claude Code to get a second opinion on my MRI

#272

Earlier quoted context omitted.

Why is it psychosis and not lower standards ? While I can understand being skeptical of non-experts' claims that such answers are enough, I don't understand why you call it "psychosis" and not simply naivety or lack of expertise. At the same time, the new so-called "models" haven't been pure transformer-based LLMs, but entire systems with tools (with access to the Internet), data storage, and the options to trigger a…

Because some people develop actual psychosis. They go down some rabbit hole with an LLM until the LLM makes them believe they invented new kind of physics that makes them go harassing experts who obviously try to ignore them because its all nonsense.

Reminds me of that clip of Travis Kalanick, sexual deviant and harasser of women, talking about "discovering new physics."

Re: I used Claude Code to get a second opinion on my MRI

#273
post #126

Earlier quoted context omitted.

No, not anytime someone is an actual expert at anything, AI output appears insufficient. That is why experts in various fields use AI. Then to say "Aha, but all of that is AI psychosis" makes obviously no sense: Why would we trust experts when they offer critique but not when they say "this is helpful"? Overall: People are not insane. AI makes mistakes and, often, fails completely. AI also helps them do things better…

I’ve never seen an expert use AI in their field beyond the initial ‘oh interesting’ stage.

[dead]

Re: I used Claude Code to get a second opinion on my MRI

#274

Earlier quoted context omitted.

> no one else seems to find this to be quite damning for the AI services being offered, preferring instanced to be wowed by the convenience and speed at which they can be delivered unreviewed and unproven information "Be wowed by the convenience and speed", or merely "take advantage of the mere availability"? What most people find to be damning about expert advice is that they simply can't get it anywhere, at any cos…

So if you want to do a surgery but you don’t see any surgeons around you ask a grocery butcher to have his way?

No, people don't even go to a butcher, they do it themselves if they can. See the countless stories about farmers and their inventiveness. Example: https://www.youtube.com/watch?v=KKaJhQBusH8

Re: I used Claude Code to get a second opinion on my MRI

#275

I feel like I'm going nuts. There are other commenters saying this is a good practice they've also done for other injuries. You are saying you are an actual radiologist and immediately clock the problems with its advice. I have seen this pattern over and over again. Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading. It is only when you do not know wha…

>I have seen this pattern over and over again. Anytime someone is an actual expert at anything, AI output appears insufficient or incomplete or outright misleading

media is awash at the moment with experts chiming in to support AI, saying their fields are being revolutionized, etc.

it seems unsurprising to me that the laymen opinion would follow the loudest media trumpets.

Re: I used Claude Code to get a second opinion on my MRI

#277

Earlier quoted context omitted.

I seriously doubt that data set poisoning will be a real limiter in model performance. For one, if your website/book is poisoned, who is going to trust it for anything at all, much less for training models? For two, all the major AI labs hire or contract for subject matter experts to create curated data sets, evaluate model performance, etc. Unless they hire malicious experts, this will provide a growing, high qualit…

I think you underestimate just how much money is being poured into LLM SEO at the moment. It's real quiet because they don't want to draw attention and countermeasures from the frontier labs, but this is getting huge investment, and they will have a monomaniac focus on juicing product results whereas the attention of the labs necessarily has to be spread out.

Who's doing llm seo right now? How does that work when you only gets feedback every few months when a new model is out?

Re: I used Claude Code to get a second opinion on my MRI

#278

> There's something incredibly peaceful about being in the hands of an expert you trust. [...] AI can absolutely shatter that feeling in an uncomfortable way [...] but I don't know if I can fully trust AI either. This really is key. We know we can't trust the AI, but at the same time we're also more comfortable asking the AI for clarifications or confronting it. Not having a time-bound appointment or paying by the ho…

To provide a competing point of anecdata: A Gemini diagnosis saved me $3,000 in unnecessary repairs on my Civic.

Re: I used Claude Code to get a second opinion on my MRI

#279

Earlier quoted context omitted.

This is the root of AI psychosis. There’s a lot of unpack here, and I won’t go too deep because you can’t really have a discussion with affected folks because their fundamental basis is not evidence, it’s belief. It is weirdly religious in a way, because if you were to present contrary evidence (e.g. experts in a field weighing in about how plausible sounding responses are bunk), you would only be told you don’t beli…

>This is the root of AI psychosis. There’s a lot of unpack here, and I won’t go too deep because you can’t really have a discussion with affected folks because their fundamental basis is not evidence, it’s belief. Treating it as if it is an intelligence is the problem. The problem is that AI psychosis is fundamentally the belief that an LLM is "thinking" at all. Outputs are just believable word vomit which resembles…

You're confusing the training method with the internal process. If I had you repeatedly attempt to learn how to make believable completions of partial documents about a given topic, you would eventually learn things about that topic and could use your knowledge to create more believable completions of documents about that topic.

Re: I used Claude Code to get a second opinion on my MRI

#280

> They injected me with Traumeel, which is registered in Germany as a homeopathic medicine "without a therapeutic indication". This single sentence provides a huge clue about what’s going on: This person’s medical team is not good. It’s not hard to get an LLM to perform better than a team that is injecting homeopathic botanical formulations and performing procedures that aren’t indicated for the condition. I think th…

> I won't go into the details, but he suggested I get an MRI, which the clinic conveniently had available.

And

> They performed shockwave therapy on my shoulder

(a procedure that may not be effective, but is unlikely to cause any harm)

Its not just about LLM's being better, its about people not trusting DR any more: https://www.physiciansweekly.com/post/the-erosion-of-trust-i...

If we want to fault the article for anything it's that he didnt take that information and go get a 2nd opinion from someone who IS more informed.

Post reply on HN