Live data from Hacker News

ChatGPT terms disallow its use in providing legal and medical advice to others

ctvnews.ca

431–439 of 439 posts

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#431

Earlier quoted context omitted.

As an attorney, I don't see what the value of that would be if I have to double check its work. How else could I verify that the output is correct?

The value is, at least in my field, that checking for correctness is often a less tiring task than writing the code. With proper prompting, the LLM will also cover more corner cases than will a human think to cover. And to be honest, I really like the names of internal identifiers that LLM come up with. It's a skill that is notoriously lacking in software development. Additionally, code review with the proper tools c…

That's great for people who write code!

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#432

Earlier quoted context omitted.

I would expect that to work exactly how I code with it. I would examine the inferred output, decide if it is fit for purpose, and if so then commit it. If not, I would either refine my prompt or make the fixes to the inferred code myself. Would this hypothetical legal professional not verify that the inferred output (which is really a prediction) is correct?

As an attorney, I don't see what the value of that would be if I have to double check its work. How else could I verify that the output is correct?

The key is to not give it any agency over the work product but rather have it act as an editor or advisor that can offer suggestions but every thing that goes into the document is typed by human hands.

Giving it a document and asking it about edge cases or things that may be not covered in the document. Asking it for various ways that one could argue against a given pleading and then considering ways that those could be headed off before they could even be raised.

In my on cases (writing short fiction), having it act as an editor and identifying grammatical mistakes, contradictory statements, ambiguous sentences, and tone mismatch for a given character has been very helpful... but I don't have it write the short fiction for me.

---

For software where it may be used to generate some material (write a short function that does...) the key is short. Something that I can verify and reason about without too much effort.

However, changes that are of the scope of hundreds of lines are exhausting to review no matter if an LLM or a junior dev wrote them. I would expect that similar things would be the case of several paragraphs or pages of legalese that would need additional levels of reading and reasoning and verifying.

If its too much to reason about and verify - its asking too much.

I'd no more trust an LLM to find citations to cases than I'd trust it to program a lesser known framework (where they've been notorious for hallucinating up functions that don't exist).

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#433
post #432

Earlier quoted context omitted.

As an attorney, I don't see what the value of that would be if I have to double check its work. How else could I verify that the output is correct?

The key is to not give it any agency over the work product but rather have it act as an editor or advisor that can offer suggestions but every thing that goes into the document is typed by human hands. Giving it a document and asking it about edge cases or things that may be not covered in the document. Asking it for various ways that one could argue against a given pleading and then considering ways that those could…

>The key is to not give it any agency over the work product but rather have it act as an editor or advisor that can offer suggestions but every thing that goes into the document is typed by human hands.

>Giving it a document and asking it about edge cases or things that may be not covered in the document.

As an attorney, how am I supposed to trust that it gave a proper output on the edge cases without reading the document myself?

>Asking it for various ways that one could argue against a given pleading and then considering ways that those could be headed off before they could even be raised.

Do people think attorneys don't know how to do their day-to-day jobs? We generally do not have issues coming up with how to argue against a pleading. Maybe if you're some sort of small-time generalist, working on an issue you hadn't before, but that's not most attorneys. And then, I'd be worried. You are basically not capable of having the expertise needed to verify the model's output for correctness anyway. This is why attorneys work in networks. I'd just find a colleague or a network of attorneys specializing in that area and find out from them what is needed, rather than trusting that an LLM knows all that because it was digested from the entire public Internet.

I've said it here before too, I think people talking about using AI as an attorney don't really understand what attorneys do all day.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#434

Earlier quoted context omitted.

> I’ve had a therapist recommend me take a motorbike trek across Europe (because that’s what he did) to cure my depression. When I try to help people in support group/ therapy group although I am not a therapist, I also try to explain how I fixed my issues or how I do so. I feel like, that isn't bad take to be really honest in the sense that I personally feel like there are times when we lose the fact that our lives…

But telling someone living in New York with a full-time job and a girlfriend etc, that the solution to their depression is to quit their job and take several months to travel across Europe on a motorbike isn't exactly practical advice. Which was my point. I could get better advice by asking an LLM what to do about my depression.

Ah context matters.. for someone currently single lets say with no jobs and feeling lack of purpose, it wouldn't have been so bad. Maybe tried to self project with different context and I mean, its understandable why you might feel this way regarding him

I still doubt asking an LLM about depression if I am being honest, I just don't think its the best thing overall or something that should be considered norm I suppose but I am not sure as even in things like these context matters.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#435
post #258

Earlier quoted context omitted.

And this seems actually wildly reasonable. It’s actually pretty scammy to take people’s money (or whatever your business model is) for legal or medical advice just to give them whatever AI shits out. If I wanted ChatGPT’s opinion (as I actually often do) I’d just ask ChatGPT for free or nearly-free. Anyone repackaging ChatGPT’s output as fit for a specialized purpose is scamming their customers.

What if Chat GPT is used as a "power tool" for actual legal / medical professionals? E.G. Here's the set of documents uploaded by the customer. Here are my most important highlights (notice that document #68 is an official letter from last year informing the person that form 68d doesn't need to be filled in their specific situation). Here are my takeaways. Here's my recommendation. Apporve or change?

IMO the professionals themselves are free to do so, in the same way they can choose to skim rather than read, or to ask their 13-year-old nephew to read and summarize a document for them in exchange for a Minecraft gift card: In the end the professional is staking their reputation and applicable license(s) on those third parties. If they all work perfectly nobody ever needs to know -- and if they get it wrong because of that shortcut, the professional deserves to be nailed to the wall for it.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#436

Earlier quoted context omitted.

Indeed. Similarly, I like now having ChatGPT as the absolute lowest bar of service I’m willing to accept. If you aren’t a better therapist, lawyer or programmer than it then why would I think about paying you.

Having chatgpt as your therapist is actually wild. Its yes-man abilities etc. will not help you and its always helpful to talk to another human being in the loop during therapy so that you know you are actually being sane. Don't ever compromise money on your mental health. If you need to, either join offline anonymous support groups or join some good forums/discord servers/reddit about therapy if you can not even aff…

I didn’t say to use ChatGPT as a therapist——I said don’t use a human therapist who is worse than it.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#437
post #320

Earlier quoted context omitted.

We had the diagnosis before I started with the LLM. The radiology showed the problem and the surgeries worked. Down to an ultrasound a year now! We took him to our local ER, they ran tests. I gave the LLM just the symptom list that I gave to the ER initially. It replied with all the things they tested for. I gave the test results, and it suggested a short list with diagnostics that included his actual Dx and the corr…

That's great that it worked so quickly too (and you could arrange surgery on such short notice). I'm sure more people with same issue may benefit from more details?

As it's my son's health issues, not my own, I'm going to preserve his privacy until he can consent to sharing in...8 years.

Re: ChatGPT terms disallow its use in providing legal and medical advice to others

#439
post #437

Earlier quoted context omitted.

That's great that it worked so quickly too (and you could arrange surgery on such short notice). I'm sure more people with same issue may benefit from more details?

As it's my son's health issues, not my own, I'm going to preserve his privacy until he can consent to sharing in...8 years.

Apparently this news is just that it's "not allowed" by ToS, but ChatGPT will still give advice so it doesn't really matter. I thought the new model already denied you advice because you said you used an older model, but I guess it was unrelated to this news.

By the way unless you used an anonymous mode I wonder how much the model knew from side channels that could contribute to suggesting correct diagnosis...

Post reply on HN