Just after Kim Kardashian blamed Chatgpt for failing the bar exam
And it had nothing to do with her being a vacuous idiot.
ChatGPT terms disallow its use in providing legal and medical advice to others
221–230 of 439 posts
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#222Earlier quoted context omitted.
Survivorship bias.
Experience working with doctors a few times, and then we’ll see all the bias if one is still surviving lol. Doctors are some of the most corrupt professions who are more focused on selling drugs they get paid commission for to promote, or they obsess over tons and tons of expensive medical tests, that they themselves often know is not needed, except they ask for it, simply out of fear of courts suing them for neglige…
> But worshipping them as holier than thou gods is bullshit
I'd say the same about AI.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#223I've used ChatGPT to help understand medical records too. It's definitely faster than searching everything on my own, but whether the information is reliable still depends on personal judgment or asking a real doctor.
More people are treating it like a doctor or lawyer now, and the more it's used that way, the higher the chance something goes wrong. OpenAI is clearly drawing a line here. You're free to ask questions, but it shouldn't be treated as professional advice, especially when making decisions for others.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#224I wouldn't be surprised to see new products from OpenAI targeted specifically at doctors and/or lawyers. Forbidding them from using the regular ChatGPT with legal terms would be a good way to do price discrimination.
I have seen "AI" in my Dr's office. They have been using it to summarize visits and write after visit notes.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#225That’s a fair limitation. Legal and medical advice can directly impact someone’s life or safety, so AI tools must stay within ethical and regulatory boundaries. It’s better for AI to guide people toward professional help than pretend to replace it.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#226Earlier quoted context omitted.
The medical profession has generally been more open to AI. The long predicted demise of Radiology because of ML never happened. Lots of opportunity to incorporate AI into medical records to assist. The legal profession is far more at threat with AI. AI isn’t going to replace physical interactions with patients, but it might replace your need for a human to review a contract.
I assure you the medical profession is not generally open to non-medical professionals using AI for medical purposes.
The medical profession is not open about any kind of self diagnosis.
I've learned through experience that telling a doctor "I have X and I would like to be treated with Y" is not a good idea. They want to be the ones who came up with the diagnosis. They need to be the smartest person in the room. In fact I've had doctors go in a completely different direction just to discredit my diagnosis. Of course in the end I was right. That isn't to say I'm smarter, I'm not, but I'm the one with the symptoms and I'm better equipped to quickly find a matching disease.
Yes some doctors appreciate the initiative. In my experience most do not.
So now I just usually tell them my symptoms but none of the research I did. If their conclusion is widely off base I try to steer them towards what my research said.
So far so good but wouldn't it be nice if all doctors had humility?
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#227I wouldn't be surprised to see new products from OpenAI targeted specifically at doctors and/or lawyers. Forbidding them from using the regular ChatGPT with legal terms would be a good way to do price discrimination.
I have seen "AI" in my Dr's office. They have been using it to summarize visits and write after visit notes.
That's likely DAX Copilot, which doesn't provide medical advice.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#228It's not stopping to give legal/medical advice to the user, but it's forbidden to use ChatGPT to pose as an advisor giving advice to others: https://www.tomsguide.com/ai/chatgpt/chatgpt-will-still-offe...
Good. Now we just need to add technical advice to the list of advices which ChatGPT cannot be used to cite for
This. I already seen too many cases of people wiping out their systems while trying to follow invalid advices from ChatGPT.
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#229Earlier quoted context omitted.
So if you set temperature=0 and run the LLM serially (making it deterministic) it would stop hallucinating? I don't think so. I would guess that the nondeterminism issues mentioned in the article are not at all a primary cause of hallucinations.
I thought that temperature can never actually be zero or it creates a division problem or something similar. I'm no ML or math expert, just repeating what I've heard.
That's an implementation detail I believe. But what I meant was just greedy decoding (picking the token with the highest logit in the LLM output), which can be implemented very easily
Re: ChatGPT terms disallow its use in providing legal and medical advice to others
#230Earlier quoted context omitted.
Experience working with doctors a few times, and then we’ll see all the bias if one is still surviving lol. Doctors are some of the most corrupt professions who are more focused on selling drugs they get paid commission for to promote, or they obsess over tons and tons of expensive medical tests, that they themselves often know is not needed, except they ask for it, simply out of fear of courts suing them for neglige…
> But worshipping them as holier than thou gods is bullshit I'd say the same about AI.
> I'd say the same about AI.
And you’d be right, so society should let people use AI while warning them about all the risks related to it, without banning it or hiding it behind 10,000 lawsuits and making it disappear by coercion.