Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT Health is a marketplace, guess who is the product?

consciousdigital.org

Post reply on HN
Print view View original

251–260 of 330 posts

Re: ChatGPT Health is a marketplace, guess who is the product?

#251

Post by al_borland »

seydor wrote: post #4

ChatGPT mostly refuses to talk health issues , while i have found Gemini is reasonably cooperative when asking for things like symptoms and treatments . This makes me not wanting to try out their new offering.

My dad used ChatGPT to guide him through testing, diagnosis, preparation, and recovery from a quadruple bypass. He never mentioned it refusing to talk about anything, just about how indispensable it was in the process and saved him months of time over skipping it and relying on the medical system alone, without help.

For example, it told him to go out and get a test on his own before meeting with a certain specialist, so the specialist didn’t order it during the first meeting and then need to wait for a follow up after reviewing it. He did this, gave the results to ChatGPT, which sounded the alarm. He sent a message with the results to his doctor and his appointment with the specialist was moved up to the same week, instead of 3 months out.

Re: ChatGPT Health is a marketplace, guess who is the product?

#252

Post by whatevermom4 »

Forgeties79 wrote: post #153
cm2012 wrote: post #149

Earlier quoted context omitted.

I'll take a mysterious and amorphous future risk of privacy violations any day over current chronic pain.

It’s not mysterious and amorphous. We have seen the results with social media for what? 15 years now? This is a known issue with clear parallels. And health data is way riskier to have floating around.

That's obviously a take from someone who never suffered chronic pain. If you have a life-long mystery illness that doctors don't care about, obviously you're going to give your data to ChatGPT Health because at least, it looks like it's listening...

Re: ChatGPT Health is a marketplace, guess who is the product?

#253

Post by JumpCrisscross »

bwb wrote: post #12

ChatGPT has made a material difference in my ability to understand health problems, test results, and to communicate with doctors effectively. My wife and I were talking last night about how helpful it was in 2025. I hope that it continues to be good at this. I want regulators to keep an eye on this and make smart laws. I don't want it to go away, as its value is massive in my life. (One example, if you are curious:…

> to communicate with doctors effectively

Did the doctors agree? I never thought of AI as a good patient navigator, but maybe that’s its proper role in healthcare.

Re: ChatGPT Health is a marketplace, guess who is the product?

#254

Post by JumpCrisscross »

hsuduebc2 wrote: post #52
SecretDreams wrote: post #27

LLMs for medical info are good, but they're easily abuseable. I've got a friend who is an anxious mom. They use gpt/Gemini to "confirm" all of their suspicions and justify far more doctor/medical visits than is at all reasonable, while also getting access to more recurring antibiotics than is reasonable. LLMs are basically giving them the gun powder to waste the doctor's time and slam an already stressed medical syst…

Yeah, it’s a very powerful tool, and it needs to be used carefully and with intent. People on Hacker News mostly get that already, but for ordinary users it’s a full-on paradigm shift. It moved from: A very precise source of information, where the hardest part was finding the right information. To: Something that can produce answers on demand, where the hardest part is validating that information, and knowing when to…

> People on Hacker News mostly get that already

It’s super easy to stop fact checking these AIs and just trust they’re reading the sources correctly. I caught myself doing it, went back and fact checked past conversations, and lo and behold in two cases shit was made up.

These models are built to engage. They’re going to reinforce your biases, even without evidence, because that’s flattering and triggers a dopamine hit.

Re: ChatGPT Health is a marketplace, guess who is the product?

#255

Post by DBNO »

avalys wrote: post #141
simianwords wrote: post #76

Earlier quoted context omitted.

You are exaggerating. LLMs simply don’t hallucinate all that often, especially ChatGPT. I really hate comments such as yours because anyone who has used ChatGPT in these contexts would know that it is pretty accurate and safe. People also can generally be trusted to identify good from bad advice. They are smart like that. We should be encouraging thoughtful ChatGPT use instead of showing fake concern at each opportun…

All we can do is share anecdotes here, but I have found ChatGPT to be confidently incorrect about important details in nearly every question I ask about a complex topic. Legal questions, question about AWS services, products I want to buy, the history a specific field, so many things. It gives answers that do a really good job of simulating what a person who knows the topic would say. But details are wrong everywhere…

I definitely agree that ChatGPT can be incorrect. I’ve seen that myself. In my experience, though, it’s more often right than wrong.

So when you say “in nearly every question on complex topics", I’m curious what specific examples you’re seeing.

Would you be open to sharing a concrete example?

Specifically: the question you asked, the part of the answer you know is wrong, and what the correct answer should be.

I have a hypothesis (not a claim) that some of these failures you are seeing might be prompt-sensitive, and I’d be curious to try it as a small experiment if you’re willing.

Re: ChatGPT Health is a marketplace, guess who is the product?

#256

Post by newyankee »

matt3D wrote: post #179
trollbridge wrote: post #18

Earlier quoted context omitted.

This sounds like excellent evidentiary material for a future insurer or government health provider to decide you're uninsurable, not eligible for a job, and so on. And the great thing about it is that you already signed all your rights away for them to do this exact thing , when we could have had an open world with open models run locally instead where you got to keep your private health information private.

These strawman arguments lack nuance. If the person can use AI to lead a noticeably better life, something that may have been impossible previously due to economic circumstance, then the first order benefits outweigh the second order drawbacks. I’m not disputing what you’re saying, I just think that treating it like a zero sum game every time the conversation comes up is showing an immense amount of privilege. You, m…

there is also no easy way to build a perfect health AI without giving up some privacy. Now there will always be risks, but this is why I think China might overtake everyone else in Healthcare AI at the least

Re: ChatGPT Health is a marketplace, guess who is the product?

#257

Post by Forgeties79 »

whatevermom4 wrote: post #252
Forgeties79 wrote: post #153

Earlier quoted context omitted.

It’s not mysterious and amorphous. We have seen the results with social media for what? 15 years now? This is a known issue with clear parallels. And health data is way riskier to have floating around.

That's obviously a take from someone who never suffered chronic pain. If you have a life-long mystery illness that doctors don't care about, obviously you're going to give your data to ChatGPT Health because at least, it looks like it's listening...

You have no clue what my medical history is and I will not be sharing it. Clearly you have an axe to grind. You refuse to try and actually discuss this topic without assuming you have the high ground that you’re depending on to spike any attempt at conversation.

Have a good rest of your weekend.

Re: ChatGPT Health is a marketplace, guess who is the product?

#258

Post by rendaw »

nyrikki wrote: post #241
Aurornis wrote: post #227

Earlier quoted context omitted.

> and the reason no one is called out for "buying Google searches and denying applicants for searching for naughty words" is because it is trivial to make legal. Citation needed for a claim of this magnitude. > It is well documented in many many places, people just don't care. Yes, please share documentation of companies buying search data and rejecting candidates for it. Like most conspiracy theories, there are a lo…

Like most cults, you ignore direct links with cites from multiple governments agencies, but here is another. https://www.upturn.org/work/comments-to-the-cfpb-on-data-bro... > Most employers we examined used an ATS capable of integrating with a range of background screening vendors, including those providing social media screens, criminal background checks, credit checks, drug and health screenings, and I-9 and E-Veri…

You keep straying from the question. The question was: who has access to google searches? RTB isn't google searches. Background screening isn't google searches. Social media isn't google searches. Cookies aren't google searches. etc etc

Every link you provided is for tangential things. They're bad, yes, but they're not google searches. Provide a link where some individual says "Yes, I know what so-and-so searched for last wednesday."

Re: ChatGPT Health is a marketplace, guess who is the product?

#259

Post by tl »

basket_horse wrote: post #248
bossyTeacher wrote: post #218

Earlier quoted context omitted.

>the effort on their end was almost exclusively on technical and cultural fit interviews How could you possibly know if they use other undisclosed methods as part of the recruitment? You are assuming Palatir would behave ethically. Palantir, the company that will never win awards based on ethics

You’re over thinking it. Like all top tech companies, they just want the best engineers.

On the contrary, they hire the trendiest: https://danluu.com/programmer-moneyball/

Re: ChatGPT Health is a marketplace, guess who is the product?

#260

Post by hackitup7 »

bwb wrote: post #12

ChatGPT has made a material difference in my ability to understand health problems, test results, and to communicate with doctors effectively. My wife and I were talking last night about how helpful it was in 2025. I hope that it continues to be good at this. I want regulators to keep an eye on this and make smart laws. I don't want it to go away, as its value is massive in my life. (One example, if you are curious:…

I've had a similar positive experience and I'm really surprised at the cynicism here. You have a system that is good at reading tons of literature and synthesizing it, which then applies basic logic. What exactly do the cynics think that doctors do?

I don't use LLMs as the final say, but I do find them pretty useful as a positive filter / quick gut check.

Post reply on HN