Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT terms disallow its use in providing legal and medical advice to others

ctvnews.ca

Post reply on HN
Print view View original

181–190 of 439 posts

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#181

Post by throwaway290 »

cj wrote: post #17
throwaway290 wrote: post #6

Earlier quoted context omitted.

this is fresh news right? a friend just used chatgpt for medical advice last week (stuffed his wound with antibiotics after motorbike crash). are you saying you completely treated the congenital issue in this timeframe?

He’s simply saying that ChatGPT was able to point them in the right direction after 1 chat exchange, compared to doctors who couldn’t for a long time. Edit: Not saying this is the case for the person above, but one thing that might bias these observations is ChatGPT’s memory features. If you have a chat about the condition after it’s diagnosed, you can’t use the same ChatGPT account to test whether it could have diag…

> He’s simply saying that ChatGPT was able to point them in the right direction after 1 chat exchange, compared to doctors who couldn’t for a long time

He literally wrote that. I asked how he knows it's the right direction.

it must be treatment worked. otherwise it is more or less just a hunch

people go "oh yep that's definitely it" too easily. it is the problem with self diagnosing. And you didn't even notice it happened...

without more info this is not evidence.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#182

Post by zamadatix »

whatsupdog wrote: post #178
ekianjo wrote: post #174

Earlier quoted context omitted.

> They poke, they prod, they manipulate, they look, listen, and smell. Rarely. Most visits are done in 5 minutes. The physician that takes their time to check everything like you claim almost does not exist anymore.

Here in Canada ever since COVID most "visits" are a telephone call now. So the doctor just listens your words (same as a text input to an LLM) and orders tests (which can be uploaded to an LLM) if they need.

For a good 90% of typical visits to doctors this is probably fine.

The difference is a telehealth is much better at recognizing "I can't given an accurate answer for this over the phone, you'll need to have some tests done" or cast doubt on the patient's accuracy of claims.

Before someone points out telehealth doctors aren't perfect at this: correct, but that should make you more scared of how bad sycophantic LLMs are at the same - not willing to call it even.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#184

Post by cwnyth »

inglor_cz wrote: post #120
schiffern wrote: post #51

Earlier quoted context omitted.

>checking my now diagnosed gastritis I got stuff from GERD to CRC depending on which symptoms I decide to stress and which events I emphasize in the history So... exactly the same behavior as human doctors?

ChatGPT and similar tools hallucinate and can mislead you. Human doctors, on the other hand ... can be tired, hungover, thinking about a complicated case ahead of them, nauseous from a bad lunch, undergoing a divorce, alcoholics, depressed... We humans have a lot of failure modes.

Human doctors also know how to ask the right follow-up questions.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#187

Post by cpfohl »

terminalshort wrote: post #110
cpfohl wrote: post #3

Tricky…my son had a really rare congenital issue that no one could solve for a long time. After it was diagnosed I walked an older version of chat gpt through our experience and it suggested my son’s issue as a possibility along with the correct diagnostic tool in just one back and forth. I’m not saying we should be getting AI advice without a professional, but I’m my case it could have saved my kid a LOT of physical…

Why are you saying we shouldn't get AI advice without a "professional", then? Why is everybody here saying "in my experience it's just as good or better, but we need rules to make people use the worse option"? I have narcolepsy and it took a dozen doctors before they got it right. AI nails the diagnosis. Everybody should be using it.

I’m saying that is a great tool for people who can see through the idiotic nonsense they so often make up. A professional _has_ the context to see through it.

It should empower and enable informed decisions not make them.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#188

Post by mbesto »

sethhochberg wrote: post #89
ctoth wrote: post #79

Earlier quoted context omitted.

I keep seeing this problem more and more with humans. What should we call it? Maybe Hallucinations? Where there is an accurate true thing and then it just gets altered by these guys who call themselves journalists and reporters and the like until it is just ... completely unrecognizable? I'm pretty sure it's a fundamental issue with the architecture.

I know this is written to be tounge-in-cheek, but its really almost the exact same problem playing out on both sides. LLMs hallucinate because training on source material is a lossy process and bigger, heavier LLM-integrated systems that can research and cite primary sources are slow and expensive so few people use those techniques by default. Lowest time to a good enough response is the primary metric. Journalists o…

> LLMs hallucinate because training on source material is a lossy process and bigger,

LLMs hallucinate because they are probabilistic by nature not because the source material is lossy or too big. They are literally designed to create some level of "randomness" https://thinkingmachines.ai/blog/defeating-nondeterminism-in...

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#190

Post by mensetmanusman »

storus wrote: post #186

I used DeepSeek to draft a legal letter for some dispute with some marketplace that didn't want to do what I paid for. Within 2 days after sending that email all was resolved. I would hate to lose that option.

You can still do that, they are just saying they aren’t on the hook when things go wrong.
Post reply on HN