Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT Health is a marketplace, guess who is the product?

consciousdigital.org

Post reply on HN
Print view View original

101–110 of 330 posts

Re: ChatGPT Health is a marketplace, guess who is the product?

#101

Post by simianwords »

ipaddr wrote: post #99
simianwords wrote: post #76

Earlier quoted context omitted.

You are exaggerating. LLMs simply don’t hallucinate all that often, especially ChatGPT. I really hate comments such as yours because anyone who has used ChatGPT in these contexts would know that it is pretty accurate and safe. People also can generally be trusted to identify good from bad advice. They are smart like that. We should be encouraging thoughtful ChatGPT use instead of showing fake concern at each opportun…

LLM give false information often. The ability for you to catch incorrect facts is limited by your knowledge and ability and desire to do independent research. LLMs are accurate with everything you don't know but are factually incorrect with things you are an expert in is a common comment for a reason.

No they don’t give false information often.

Re: ChatGPT Health is a marketplace, guess who is the product?

#102

Post by anal_reactor »

simianwords wrote: post #85
Flatterer3544 wrote: post #80

Earlier quoted context omitted.

And how would you know what they base their hiring upon? You would just get a generic automated response.. You would not be privy to their internal processes, and thusfar not be able to prove wrong doing. You would just have to hope for a new Snowden and that the found wrongdoings would actually be punished this time.

Do corporations use my google searches as data to hire me?

Not yet. But Google itself would ask you for your resume if you happened to search for a lot of things related to programming.

Re: ChatGPT Health is a marketplace, guess who is the product?

#103

Post by DetectDefect »

simianwords wrote: post #100
DetectDefect wrote: post #98

Earlier quoted context omitted.

Not really. The provide convenience, sure, but fundamentally all technology creates dependence and limits freedom by influencing behavior in subtle ways, while disproportionately benefiting the technology owner/operator.

You are part of the demographic I described.

Cool. Got anything interesting to say to us, besides expressing your disbelief at our mere existence?

Re: ChatGPT Health is a marketplace, guess who is the product?

#104

Post by JKCalhoun »

jsheard wrote: post #22
bwb wrote: post #12

ChatGPT has made a material difference in my ability to understand health problems, test results, and to communicate with doctors effectively. My wife and I were talking last night about how helpful it was in 2025. I hope that it continues to be good at this. I want regulators to keep an eye on this and make smart laws. I don't want it to go away, as its value is massive in my life. (One example, if you are curious:…

On the other hand, sometimes you end up like this guy. Are you feeling lucky? https://arstechnica.com/health/2025/08/after-using-chatgpt-m...

"…a 60-year-old man who had a “history of studying nutrition in college” decided to try a health experiment: He would eliminate all chlorine from his diet…"

You can see already that this can easily go sideways. This guy is already exploring the nether regions of self-medication.

It would be ideal if LLMs recognized this and would not happily offer up bromine as a substitute for chlorine, but I suspect this guy would have greedily looked for other shady advice if LLMs had never existed.

Re: ChatGPT Health is a marketplace, guess who is the product?

#105

Post by ipaddr »

maxerickson wrote: post #88
DetectDefect wrote: post #84

Earlier quoted context omitted.

> It is inconceivable for this demographic to think of a product that can enrich both the corporation and the users. Would you care to provide an example of such a product, to dissuade this perceived demographic cohort? I am not so certain your creative name calling will yield much results, however.

It's literally everything that people in relatively free markets buy. Microsoft Windows is a great example that people will get really angry about, but like bubble gum also enriches the producer, seller and buyer.

Those are not great examples.

Bubble gum puts the buyer in a worse dental health situation.

Windows is a monopoly that controls the desktop market and the buyer would have been better off with a richer market with a variety of options.

You could have said cigarettes. They provide the same pleasure benefits as gum with unhealthy outcomes for the buyer.

Re: ChatGPT Health is a marketplace, guess who is the product?

#106

Post by JKCalhoun »

datsci_est_2015 wrote: post #54
bwb wrote: post #12

ChatGPT has made a material difference in my ability to understand health problems, test results, and to communicate with doctors effectively. My wife and I were talking last night about how helpful it was in 2025. I hope that it continues to be good at this. I want regulators to keep an eye on this and make smart laws. I don't want it to go away, as its value is massive in my life. (One example, if you are curious:…

It seems like outcomes are probably K-shaped: those who are capable of critical thinking and deciding what type of information should be confirmed by a healthcare professional and what type of information is relatively riskless to consume from ChatGPT should have positive outcomes. Those who are prone to disinformation and misinterpretation may experience some very negative health outcomes.

I agree with that. The question I suppose is whether an LLM can detect, perhaps by the question itself, if they are dealing with someone (I hate to say it) "stable".

Anyone asking how to commit suicide, as a recent example, should be an obvious red flag. We can get more nuanced from there.

Re: ChatGPT Health is a marketplace, guess who is the product?

#107

Post by simianwords »

DetectDefect wrote: post #94
simianwords wrote: post #93

Earlier quoted context omitted.

For sure I get much much more value out of it than I pay

That is not the asymmetrical power dynamic described between you and technology.

“Power dynamic” yet another metaphysical concern

Re: ChatGPT Health is a marketplace, guess who is the product?

#108

Post by JKCalhoun »

phatfish wrote: post #63
atmosx wrote: post #20

Earlier quoted context omitted.

I agree. LLMs cannot and should not replace professionals but there are huge gaps that can be filled by intro provided and the fact that you can dig deeper into any subject is huge. This is probably a field that MistralAI could use privacy and GDPR as leverage to build LLMs around that.

One of the big issues I have with LLMs that when you start a prompting session with an easy question it all goes great. It bring up points you might not have considered and appears very knowledgeable. Fact checking at this stage will show the LLM is invariably correct. Then you start "digging deeper" on a specific sub-topic, and this is where the risk of an incorrect response grows. But it is easy to continue with th…

That's a good point—and I have probably fallen victim to it as well: the "sliding scale" of an LLM's authority.

Like you, I fact-check it (well, search the internet to see if others validate the claims/points) but I don't do so with every response.

Re: ChatGPT Health is a marketplace, guess who is the product?

#109

Post by hsuduebc2 »

SecretDreams wrote: post #73
hsuduebc2 wrote: post #52

Earlier quoted context omitted.

Yeah, it’s a very powerful tool, and it needs to be used carefully and with intent. People on Hacker News mostly get that already, but for ordinary users it’s a full-on paradigm shift. It moved from: A very precise source of information, where the hardest part was finding the right information. To: Something that can produce answers on demand, where the hardest part is validating that information, and knowing when to…

> This happened in a year or two so I can't really blame. The truth machine where you doesn't needed to focus too much on validating answers changed rapidly to slop machine where ironically, your focus is much more important. Very much this for the general public. I view it as borderline* dangerous to anyone looking for confirmation bias.

Yea. Especially with absolutele garbage that is gooogle ai summary, which is just slightly worse than their "AI mode". I never saw anything hallucinate that much. It is much worse that it is included in every search and it have the google "stamp of quality" which was usually mark of well functioning product.

Re: ChatGPT Health is a marketplace, guess who is the product?

#110

Post by JKCalhoun »

metalliqaz wrote: post #13
bwb wrote: post #12

ChatGPT has made a material difference in my ability to understand health problems, test results, and to communicate with doctors effectively. My wife and I were talking last night about how helpful it was in 2025. I hope that it continues to be good at this. I want regulators to keep an eye on this and make smart laws. I don't want it to go away, as its value is massive in my life. (One example, if you are curious:…

Anything you say can and will be used against you.

You bring up an interesting point.

How is it we have come to a place in society where we second-guess everything we type? But perhaps also where we go (with our "tracking devices" in our pockets…).

I mean, obviously the internet is what changed everything. But it is like you have a megaphone strapped to your face whenever you connect to a site and make a comment.

Maybe this is not a good thing.

Post reply on HN