Live data from Hacker News

ChatGPT Health is a marketplace, guess who is the product?

consciousdigital.org

231–240 of 330 posts

Re: ChatGPT Health is a marketplace, guess who is the product?

#231
post #4

ChatGPT mostly refuses to talk health issues , while i have found Gemini is reasonably cooperative when asking for things like symptoms and treatments . This makes me not wanting to try out their new offering.

It's quite easy to "jailbreak" by asking it to discuss hypotheticals, help you write accurate information for a fictional account, etc.

This is my experience too. Most bots are happy to discuss health stuff in a vacuum, which works for some queries.

Re: ChatGPT Health is a marketplace, guess who is the product?

#232
post #145

LLMs for medical info are good, but they're easily abuseable. I've got a friend who is an anxious mom. They use gpt/Gemini to "confirm" all of their suspicions and justify far more doctor/medical visits than is at all reasonable, while also getting access to more recurring antibiotics than is reasonable. LLMs are basically giving them the gun powder to waste the doctor's time and slam an already stressed medical syst…

Yea, I'm in a particular health community. A lot of anxious individuals, for good reason, end up posting a lot of nonsense they derived from self-influenced chatgpt conversations. That said, when used as a tool you have power over - ChatGPT has also freed up some of my own anxiety. I've learned a ton thanks to ChatGPT as well. It's often been more helpful than the doctors and offers itself as an always-available coun…

Another user above described the curve as K-shaped and that resonates to me as well. Above a certain line of knowledge and discernment the user is likely to benefit from the tool. Below the line, the tool can become harmful.

Re: ChatGPT Health is a marketplace, guess who is the product?

#233
post #217

Earlier quoted context omitted.

Warning: I am not in this industry and the below is speculation: AIUI the idea is to predict the "correct" price for an individual premium, Y, which is restricted to being the result of some insurance model function, f(), that is itself restricted to the domain of age (A), location (L), and smoking status (S): Y = f(A, L, S) My impression was that the idea was that this would handicap insurers' natural desire to pric…

That’s not how courts and laws work. If you cheat and use other illegal factors to compute a premium for each person, and then create an AI model that effectively looks up your illegally calculated premium of each person by their location, they’re going to reach the obvious conclusion - you are calculating a premium using illegal factors.

Like I said: It's only useful to have location in your model's domain if you have side-channel information embedded in the model function itself about what those location data mean for the correct premium price. What we're talking about here is just a way to embed much more information in your model function than a human reasonably could.

Given the magnificent ability of DNN models to serve as obfuscatory black boxes and the general techno-ignorance of legislators and regulators, I suspect that "AI laundering" your violations actually a very effective way to juke all sorts of laws and regulations.

But both of us are just speculating. If you have insider industry knowledge or can point to regulatory guidance and/or enforcement actions in this area that corrects or confirms my understanding, I would love to read about it.

Re: ChatGPT Health is a marketplace, guess who is the product?

#234

Earlier quoted context omitted.

And how would you know what they base their hiring upon? You would just get a generic automated response.. You would not be privy to their internal processes, and thusfar not be able to prove wrong doing. You would just have to hope for a new Snowden and that the found wrongdoings would actually be punished this time.

This fails the classic conspiracy theory test: Any company practicing this would have to be large enough to be able to afford to orchestrate a chain of illegal transactions to get the data, develop a process for using it in hiring, and routinely act upon it. The continued secrecy of the conspiracy would then depend on every person involved in orchestrating this privacy violation and illegal hiring scheme keeping it s…

It doesn't though. As an aside, I have been using a competitor to chatgpt health (nori) for a while now, and I have been getting an extreme amount of targeted ads about HRV and other metrics that the app consumes. I have been collecting health metrics through wearables for years, so there has been no change in my own search patterns or beliefs about my health. I just thought ai + health data was cool.

Re: ChatGPT Health is a marketplace, guess who is the product?

#236
post #12

ChatGPT has made a material difference in my ability to understand health problems, test results, and to communicate with doctors effectively. My wife and I were talking last night about how helpful it was in 2025. I hope that it continues to be good at this. I want regulators to keep an eye on this and make smart laws. I don't want it to go away, as its value is massive in my life. (One example, if you are curious:…

Or it's a placebo effect.

And if it didn't work out and made you worse or, god forbid, the advice caused you to get seriously injured, then what? ChatGPT won't take any responsibility.

I have so many issues with our current health system but an alternative is not an unreliable search tool that takes no responsibility for the information it provides.

Re: ChatGPT Health is a marketplace, guess who is the product?

#237
post #8

I find it ironic that the article is warning against AI use while it uses an AI-made cover image. Surely they find the same fault with copyright issues and AI art? Right?

> This isn’t just a health assistant. This is infrastructure for a healthcare marketplace.

It's an AI written article IMHO.

Re: ChatGPT Health is a marketplace, guess who is the product?

#239

Earlier quoted context omitted.

The obvious retort to this is: "If I focused on my health, ate clean and exercised daily, why should I also be subsidizing Billy "video-games-are-my-exercise" fatass's chronic health conditions?" This is why there is a hyperfixation on shifting blame away from (failing) individuals. The logic breaks when Billy has to admit he just hates exercising. And yes, before you comment, I know "maybe Billy has (condition outsi…

In some respects, the ideal world is one in which everyone’s premiums are tied to a free and easy Apple Watch-like device that silently tracks exercise, blood sugar at a frequency that can tell when you ate a big dessert, air quality (and the presence of smoke or pollution), blood alcohol content, whether you are in speeding cars, whether you are participating in dangerous sports, etc. Such a system would directly co…

There's a similar phenomenon when people grouse about paying taxes for "roads I don't even use." Even if we assume zero indirect benefits, the billing infrastructure necessary to truly achieve that goal would create a creepy panopticon of constant surveillance.

This is difficult to convey to certain brands of self-styled libertarians.

Re: ChatGPT Health is a marketplace, guess who is the product?

#240
post #12

ChatGPT has made a material difference in my ability to understand health problems, test results, and to communicate with doctors effectively. My wife and I were talking last night about how helpful it was in 2025. I hope that it continues to be good at this. I want regulators to keep an eye on this and make smart laws. I don't want it to go away, as its value is massive in my life. (One example, if you are curious:…

Or it's a placebo effect. And if it didn't work out and made you worse or, god forbid, the advice caused you to get seriously injured, then what? ChatGPT won't take any responsibility. I have so many issues with our current health system but an alternative is not an unreliable search tool that takes no responsibility for the information it provides.

on a similar vein, I have recurring back issues due to a spinal issue. I gave the issue to ChatGpT and it gave me almost all of the exercise I had been given years ago by a chiropractor. It's nowhere near a replacement for having someone coach me through movements though.
Post reply on HN