B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
1–10 of 38 posts
Re: B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
#2Related:
Lawyer fined for legal filings that included 'hallucinated' AI citations
Re: B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
#3Your honor, my source is that I made it the fuck up.
Re: B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
#4"I did not intend to generate or refer to fictitious cases in this matter. That is clearly wrong and not something I would knowingly do," Ke wrote in her deposition.
"I never had any intention to rely upon any fictitious authorities or to mislead the court."
So beware what ChatGPT tells you. It might not be real and this can be a big problem in some situations.
Re: B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
#5The judge believed the offending lawyer's plea of ignorant incompetence, and declined the other side's request for extra penalties for reprehensible conduct and abuse of process. But still ordered the offender to review all her previous work submitted to the court, to identify any previous submissions of fake cases...
So a complete train wreck, that could re-open a bunch of settled cases. Or the offender and the "justice" system might quietly "decide" that they don't want to work hard at making themselves look worse, and just leave a bunch of wrongly-settled cases lie.
IANAL, but it seems long past time for judges to start pretending that they actually care about the "truth and justice" stuff, and permabanning lawyers who pull this kind of crap from the practice of law.
Re: B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
#6"I did not intend to generate or refer to fictitious cases in this matter. That is clearly wrong and not something I would knowingly do," Ke wrote in her deposition. "I never had any intention to rely upon any fictitious authorities or to mislead the court." So beware what ChatGPT tells you. It might not be real and this can be a big problem in some situations.
Every time I see a company/startup claiming to do an AI about X or Y, I wonder how they can be trusted at all. What about all the hallucinations, false positives, etc.?
Aside from some sort of tool that classify cases, or extract key points from an agreement, and talk in probabilities rather than asserting things I don't see a use for these. And I don't know if we will be able to 100% trust these tools one day.
Re: B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
#7"I did not intend to generate or refer to fictitious cases in this matter. That is clearly wrong and not something I would knowingly do," Ke wrote in her deposition. "I never had any intention to rely upon any fictitious authorities or to mislead the court." So beware what ChatGPT tells you. It might not be real and this can be a big problem in some situations.
Every time I see a company/startup claiming to do an AI about X or Y, I wonder how they can be trusted at all. What about all the hallucinations, false positives, etc.? Aside from some sort of tool that classify cases, or extract key points from an agreement, and talk in probabilities rather than asserting things I don't see a use for these. And I don't know if we will be able to 100% trust these tools one day.
We haven't figured out how to deal with human intelligence effectively. It's jumping the gun to imagine we can do AI well.
/2 cents -- as if I need a "disclaimer" but the internet being what it is....
Re: B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
#8"I did not intend to generate or refer to fictitious cases in this matter. That is clearly wrong and not something I would knowingly do," Ke wrote in her deposition. "I never had any intention to rely upon any fictitious authorities or to mislead the court." So beware what ChatGPT tells you. It might not be real and this can be a big problem in some situations.
"That is clearly wrong and not something I would knowingly do,"
Such a bullshit excuse. If you are using ChatGPT to do the donkey work for you then you are knowingly using it to cut corners.
It's like turning up in court and saying "well I asked this postman Cliff at the bar I go to his opinion on the case...".
She should loose here licence for pulling a stunt like that.
Re: B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
#9Despite what some in the tech space might think, I'm not sure I can lay the blame 100 % on the lawyer.
It's true that this is definitely malpractice and they should have known better, it's also true that big tech for years overplayed their hand with the marketing of "AI" to laypeople and management, which has created completely unreasonable expectations.
As long as OpenAI has a profit motive to make people believe ChatGPT is "right" more often than not they will never blatantly advertise that everything their product generates might be unverifiable garbage, especially in a way everyone will understand and that isn't just a liability footnote.
Re: B.C. lawyer reprimanded for citing fake cases invented by ChatGPT
#10"I did not intend to generate or refer to fictitious cases in this matter. That is clearly wrong and not something I would knowingly do," Ke wrote in her deposition. "I never had any intention to rely upon any fictitious authorities or to mislead the court." So beware what ChatGPT tells you. It might not be real and this can be a big problem in some situations.
"That is clearly wrong and not something I would knowingly do," Such a bullshit excuse. If you are using ChatGPT to do the donkey work for you then you are knowingly using it to cut corners. It's like turning up in court and saying "well I asked this postman Cliff at the bar I go to his opinion on the case...". She should loose here licence for pulling a stunt like that.
It's sufficiently good that it fools people into thinking its not even corner-cutting.
85% of the time, the source code it gives me is correct (50% of the time it's mediocre, but still correct), and that's true even when it's surprised me by spewing out an entire single-file web app rather than just disparate functions I was expecting to have to copy-paste into a single file[0]; how good or bad varies wildly in a way that suggests behind the scenes changes like all software, but it's enough that I can easily believe someone sees it on a good day, is convinced it's always that good, and doesn't keep checking.
[0] I'm not a web developer, don't bother to tell me there's a better way — my career path (for now) is iOS, where I use the LLM very differently anyway.