Live data from Hacker News

Lawyers blame ChatGPT for tricking them into citing bogus case law

apnews.com

21–30 of 180 posts

Re: Lawyers blame ChatGPT for tricking them into citing bogus case law

#22
post #18
post #5

[flagged]

This comment is settinh of my ChatGPT alarm bells. Something about the sentence structure and adjective usage.

Their recent comments have a few overly glowing and slightly unrealistic scenarios using ChatGPT.

Re: Lawyers blame ChatGPT for tricking them into citing bogus case law

#23

The cynic in me wonders if this isn’t part of a plan to create a legal precedent banning AI from handling legal disputes. Think about it: the legal profession is possibly one of the most threatened by the development of AI models. What better way to secure the professional future of the long tail of lawyers and paralegals?

No need to ban AI from handling legal disputes. Unless you're representing yourself you need a lawyer and there's no way for an AI to act as a lawyer.

I should have made my thoughts clearer; my mind immediately went to small-time stuff like handling parking disputes, which I think AI is on track to competently solve.

Re: Lawyers blame ChatGPT for tricking them into citing bogus case law

#24
post #5

[flagged]

This comment is fraudulent.

Not only is the style quite brazenly ChatGPT, this part is a huge red flag:

>ChatGPT uncovered state utilities codes...

ChatGPT cannot uncover anything, especially the municipality-specific corpus of codes that the comment ostensibly claims to have access to.

Re: Lawyers blame ChatGPT for tricking them into citing bogus case law

#26
The lawyer said: “I did not comprehend that ChatGPT could fabricate cases."

I wonder how many other people using ChatGPT do not comprehend that ChatGPT can be a confident bullshitter...

I'm surprised that this one case is getting so much attention because there must be so many instances of people using false information they got from ChatGPT.

Re: Lawyers blame ChatGPT for tricking them into citing bogus case law

#28
post #25

Misrepresenting wholly fabricated case law to a judge out of sheer incompetence has been grounds for disbarment in at most US States for over a century. ChatGPT told me that. It might be true.

Bingo.

With or without ChatGPT this is easily malpractice and potentially even fraud. My (cynical) guess is not only are they lazy and sloppy, they likely (fraudulently) over billed their clients in terms of representing billable hours spent drafting this lawsuit. They're almost certainly billing their clients (or in the case of contingency, keeping the cut they normally would) as though humans (with high hourly rates) are drafting this while having ChatGPT generate their supposed work product in seconds.

If you remove ChatGPT from the picture and look at this as if it was actually drafted by them the fraud argument strengthens. They essentially made up case law and citations that artificially (fraudulently) improves their argument before the court.

At a minimum it's grossly incompetent and when you consider my prior paragraph it strengthens the fraud angle, as they likely skimmed over the generated ChatGPT results and submitted it because it (again, artificially) strengthens their case. It seems as though ChatGPT (with whatever prompts they used) was more than happy to prioritize pleasing them vs actually being accurate.

They may as well have prompted ChatGPT with "I'm a lawyer and tell me anything you need to so I can win this case and take home the money". It's a disgrace.

What a mess - these lawyers should be disbarred and investigated for what is also likely fraudulent billing practices at minimum.

Re: Lawyers blame ChatGPT for tricking them into citing bogus case law

#30

Earlier quoted context omitted.

No need to ban AI from handling legal disputes. Unless you're representing yourself you need a lawyer and there's no way for an AI to act as a lawyer.

I should have made my thoughts clearer; my mind immediately went to small-time stuff like handling parking disputes, which I think AI is on track to competently solve.

maybe, unless the AI calculates somehow that 98% or something of parking disputes can be resolved by just not showing up in court, so that's the strategy. But you can't convey in a reasonable enough prompt that "this cop just had that look of being ready to really screw me over"...idk man.
Post reply on HN