Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

msn.com

Post reply on HN
Print view View original

31–40 of 240 posts

Re: I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

#31

Post by ytoawwhra92 »

nomel wrote: post #15
dfajgljsldkjag wrote: post #5

The author is a healthy person but the computer program still gave him a failing grade of F. It is irresponsible for these companies to release broken tools that can cause so much fear in real people. They are treating serious medical advice like it is just a video game or a toy. Real users should not be the ones testing these dangerous products.

> It is irresponsible for these companies I would claim that ignoring the "ChatGPT is AI and can make mistakes. Check important info." text, right under the query they type in client, is clearly more irresponsible. I think that a disclaimer like that is the most useful and reasonable approach for AI. "Here's a tool, and it's sometimes wrong." means the public can have access to LLMs and AI. The alternative, that you…

Why are you assuming that the general public ought to have access to imperfect tools?

I live in a place where getting a blood test requires a referral from a doctor, who is also required to discuss the results with you.

Re: I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

#32

Post by irjustin »

wawayanda wrote: post #16

A year or so ago, I fed my wife's blood work results into chatgpt and it came back with a terrifying diagnosis. Even after a lot of back and forth it stuck to its guns. We went to a specialist who performed some additional tests and explained that the condition cannot be diagnosed with just the original blood work and said that she did not have the condition. The whole thing was a borderline traumatic ordeal that I'm…

Isn't it two sides to the same coin?

You should be happy about it that it's not the thing specifically when the signs pointed towards it being "the thing"?

Re: I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

#33

Post by SchemaLoad »

wawayanda wrote: post #16

A year or so ago, I fed my wife's blood work results into chatgpt and it came back with a terrifying diagnosis. Even after a lot of back and forth it stuck to its guns. We went to a specialist who performed some additional tests and explained that the condition cannot be diagnosed with just the original blood work and said that she did not have the condition. The whole thing was a borderline traumatic ordeal that I'm…

I asked a doctor friend why it seems common for healthcare workers to keep the results sheets to themself and just give you a good/bad summary. He told me that the average person can't properly understand the data and will freak themselves out over nothing.

Re: I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

#35

Post by fn-mote »

wawayanda wrote: post #16

A year or so ago, I fed my wife's blood work results into chatgpt and it came back with a terrifying diagnosis. Even after a lot of back and forth it stuck to its guns. We went to a specialist who performed some additional tests and explained that the condition cannot be diagnosed with just the original blood work and said that she did not have the condition. The whole thing was a borderline traumatic ordeal that I'm…

> I fed my wife's blood work results into chatgpt and it came back with a terrifying diagnosis

I don't get it... a doctor ordered the blood work, right? And surely they did not have this opinion or you would have been sent to a specialist right away. In this case, the GP who ordered the blood work was the gatekeeper. Shouldn't they have been the person to deal with this inquiry in the first place?

I would be a lot more negative about "the medical establishment" if they had been the ones who put you through the trauma. It sounds like this story is putting yourself through trauma by believing "Dr. GPT" instead of consulting a real doctor.

I will take it as a cautionary tale, and remember it next time I feed all of my test results into an LLM.

Re: I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

#36

Post by orionsbelt »

wawayanda wrote: post #16

A year or so ago, I fed my wife's blood work results into chatgpt and it came back with a terrifying diagnosis. Even after a lot of back and forth it stuck to its guns. We went to a specialist who performed some additional tests and explained that the condition cannot be diagnosed with just the original blood work and said that she did not have the condition. The whole thing was a borderline traumatic ordeal that I'm…

> "A year or so ago"

What model?

Care to share the conversation? Or try again and see how the latest model does?

Re: I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

#37

Post by haldujai »

orionsbelt wrote: post #34
creatonez wrote: post #7

ChatGPT Health is a completely wreckless and dangerous product, they should be sued into oblivion for even naming it "health".

ChatGPT has done more for my health than any doctor. Truly.

How so?

Re: I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

#38

Post by themafia »

wawayanda wrote: post #16

A year or so ago, I fed my wife's blood work results into chatgpt and it came back with a terrifying diagnosis. Even after a lot of back and forth it stuck to its guns. We went to a specialist who performed some additional tests and explained that the condition cannot be diagnosed with just the original blood work and said that she did not have the condition. The whole thing was a borderline traumatic ordeal that I'm…

> it stuck to its guns

It gave you a probabilistic output. There were no guns and nothing to stick to. If you had disrupted the context with enough countervailing opinion it would have "relented" simply because the conversational probabilities changed.

Re: I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

#39

Post by themafia »

irjustin wrote: post #32
wawayanda wrote: post #16

A year or so ago, I fed my wife's blood work results into chatgpt and it came back with a terrifying diagnosis. Even after a lot of back and forth it stuck to its guns. We went to a specialist who performed some additional tests and explained that the condition cannot be diagnosed with just the original blood work and said that she did not have the condition. The whole thing was a borderline traumatic ordeal that I'm…

Isn't it two sides to the same coin? You should be happy about it that it's not the thing specifically when the signs pointed towards it being "the thing"?

You are _absolutely_ going to die in the next 30 minutes.

When it doesn't happen will you still be happy?

Re: I let ChatGPT analyze a decade of my Apple Watch data, then I called my doctor

#40

Post by themafia »

rfw300 wrote: post #30
elzbardico wrote: post #29

LLMs are not a mythical universal machine learning model that you can feed any input and have it magically do the same thing a specialized ML model could do. You can't feed an LLM years of time-series meteorological data, and expect it to work as a specialized weather model, you can't feed it years of medical time-series and expect it to work as a model specifically trained, and validated on this specific kind of dat…

This is true as a technical matter, but this isn't a technical blog post! It's a consumer review, and when companies ship consumer products, the people who use them can't be expected to understand failure modes that are not clearly communicated to them. If OpenAI wants regular people to dump their data into ChatGPT for Health, the onus is on them to make it reliable.

> the onus is on them to make it reliable.

That is not a plausible outcome given the current technology or of any of OpenAI's demonstrated capabilities.

"If Bob's Hacksaw Surgery Center wants to stay in business they have to stop killing patients!"

Perhaps we should just stop him before it goes too far?

Post reply on HN