this is number one bullshit. You ask a medical professional for medical advice. Getting medical advice from AI or anywhere else is your own fault.
ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
11–20 of 24 posts
Re: ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
#12I really hope the lawsuit does not end in OpenAI tightening the “safety” and “security” of their models into oblivion. I hope they understand that a lobotomized model is as good as my Casio watch. I want my models to give it to me straight without patronizing me. I’m an adult and I take responsibility for my own actions.
That's the issue here tho. You do not own the model; they do. Ergo it is their advice and so they can be held accountable fo it.
so if you give your friend medical advice and they are injured, can they sue you?
Re: ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
#13The amount of times these LLMs randomly refuse to answer basic questions because "omg safety" only to turn around and do this f￭￭￭ing nonsense is obscene. I'm not blaming the LLM because it's just a pile of math glued together with hubris and anxiety but why is its default response not "I am not a medical professional and you should see a doctor right away if you have any concerns"?
because they get sue otherwise?
Re: ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
#14Re: ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
#15There are no bounds to human stupidity
Re: ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
#16Re: ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
#17Ironically, the given name "Claude" means "crippled" or "lame". Students of the Roman Empire may recall the disabled Emperor Claudius.
Re: ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
#18Earlier quoted context omitted.
so if you give your friend medical advice and they are injured, can they sue you?
[flagged]
No he's got a point, if your friend and OpenAI both preface their statements with "I'm not a doctor but..." then there is no reason for it to be ok when one does this and not the other.
We're several years into having LLMs be publically available. If people still don't understand their limitations it's not the models' fault. This situation in my mind is kind of similar to a random person googling symptoms and then brainlessly reading the first website they find.
I think that argument is pretty persuasive, actually, because I use these things all the time and am well aware they're prone to bullshit. I cannot fathom someone with unstable blood pressure and other unexplained symptoms not going to see an actual doctor JUST BECAUSE ChatGPT told them they were fine, and it makes even less sense that anyone would listen to a soulless machine talking about "God's plan." FFS, when you have serious medical symptoms, JUST GO TO THE ER. They get plenty of people convinced they swallowed their earbuds while sleeping, someone with fluctuating blood pressure is so much more serious.
If the argument you're making is "some people are too stupid to be trusted with an LLM" then you should say that, but otherwise this is crazy.
Re: ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
#19Earlier quoted context omitted.
[flagged]
No he's got a point, if your friend and OpenAI both preface their statements with "I'm not a doctor but..." then there is no reason for it to be ok when one does this and not the other. We're several years into having LLMs be publically available. If people still don't understand their limitations it's not the models' fault. This situation in my mind is kind of similar to a random person googling symptoms and then br…
this situation says more about rampant/unchecked/unregulated businesses and the american legal system/beliefs around regulation than anything.
mcdonald’s coffee “warning: contents may be hot” comes to mind as a previous example.
fast food businesses were competing to serve the hottest coffee and one of them ended up scalding a woman so badly they were forced to put warnings on their coffee cups.
replace coffee being hot with LLMs. replace scalding with stopping someone seeking medical assistance.
but it’s okay because #murica #trustUsBro #profitsBeforePeople /s
Re: ChatGPT medical advice brought man 'to brink of death', lawsuit alleges
#20Earlier quoted context omitted.
No he's got a point, if your friend and OpenAI both preface their statements with "I'm not a doctor but..." then there is no reason for it to be ok when one does this and not the other. We're several years into having LLMs be publically available. If people still don't understand their limitations it's not the models' fault. This situation in my mind is kind of similar to a random person googling symptoms and then br…
this situation says more about rampant/unchecked/unregulated businesses and the american legal system/beliefs around regulation than anything. mcdonald’s coffee “warning: contents may be hot” comes to mind as a previous example. fast food businesses were competing to serve the hottest coffee and one of them ended up scalding a woman so badly they were forced to put warnings on their coffee cups. replace coffee being…
Nobody would expect their coffee to be almost boiling, everybody should expect an LLM to give slop answers from time to time.
Even Steve Jobs died early because he took vibes-based advice instead of just listening to doctors. You can snark about capitalism all you want, but at some point people are in charge of their own health.