Live data from Hacker News

Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

arstechnica.com

31–40 of 212 posts

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#31
post #24

Wait, this is handled as "ChatGPT made up these cases" and not as "Layers deliberately used ChatGPT to fabricate stuff"? Is anyone really believing a lawyer is that stupid? I know, adssume good intentions and all, but in this case, really?

I believe some lawyers are that stupid.

I also believe lawyers who are stupid enough not to verify ChatGPT's responses should be treated as if they willfully lied to the court. "Oops, I didn't know" is a good defence when you're caught accidentally walking on the grass, not when you're in court.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#32
post #24

Wait, this is handled as "ChatGPT made up these cases" and not as "Layers deliberately used ChatGPT to fabricate stuff"? Is anyone really believing a lawyer is that stupid? I know, adssume good intentions and all, but in this case, really?

Especially after they replied to the first queries with the assurance that the citations were real and one that couldn't be found was taken from an unpublished opinion. Negligent at best. Should be a career-ending move for the guy; he can always pivot into the burgeoning legal AI field.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#33

Sigh, I'm getting very sick of hearing about how "ChatGPT" makes stuff up. Yes, 3.5 made a lot of stuff up, 4.0 still does, but it's much rarer. I wish people would mention this, it's all treated as the same thing. It's like talking about how unreliable these "Airplanes" are when they are talking about prop planes, even though jets are out.

[deleted]

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#34

Earlier quoted context omitted.

I would hope so, at a minimum! I'm shocked that signing an affidavit in a court of law certifying the existence of made-up courses isn't simply criminal.

Intent (mens rea) is a core part of what makes a crime a crime.

Look up 'strict liability'.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#35
post #2

> "Lawyer: ChatGPT said the cases were real"

Oh boy, and this one! > The plaintiff's lawyer continued to insist that the cases were real. LoDuca filed an affidavit on April 25 in which he swore to the authenticity of the fake cases

maybe they are trolling and their long game is to sue openai

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#36
post #19

I asked ChatGPT to tell me a riddle. It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that) I asked for a hint about 5 times and it kept giving more legitimate sounding hints. Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle. I then repeated the riddle and asked ChatGPT what the answer…

Maybe the real definition of intelligence isn't being able to answer questions effectively, but being able to know what you know and know what you don't know.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#37
post #19

I asked ChatGPT to tell me a riddle. It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that) I asked for a hint about 5 times and it kept giving more legitimate sounding hints. Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle. I then repeated the riddle and asked ChatGPT what the answer…

> I asked ChatGPT to tell me a riddle.

Which version of ChatGPT, if you don't mind me asking?

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#38

Sigh, I'm getting very sick of hearing about how "ChatGPT" makes stuff up. Yes, 3.5 made a lot of stuff up, 4.0 still does, but it's much rarer. I wish people would mention this, it's all treated as the same thing. It's like talking about how unreliable these "Airplanes" are when they are talking about prop planes, even though jets are out.

I'm so sick of seeing this strawman. "Well, ChatGPT 4 is better!" Well, how should I know? I'm not paying for ChatGPT 4. At least a product like Midjourney is consistent both in its paid and unpaid form.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#39
post #5

Disbarred?

I would hope so, at a minimum! I'm shocked that signing an affidavit in a court of law certifying the existence of made-up courses isn't simply criminal.

Almost certainly not. It's astoundingly difficult to get disbarred. I heard a lawyer say the only reliable way to get disbarred is to steal money from your clients. Judges rarely even use their inherent power to sanction, though he certainly will in this case.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#40
post #19

I asked ChatGPT to tell me a riddle. It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that) I asked for a hint about 5 times and it kept giving more legitimate sounding hints. Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle. I then repeated the riddle and asked ChatGPT what the answer…

Playing “20 questions” with ChatGPT is another great way to expose its limitations. It knows the game and tries to play, but is terrible at asking questions to narrow down possible answers. I began doing this last winter, and while it tends to be a bit slow I'm quite impressed that it can manage at all.

Chat GPT versus Akinator!
Post reply on HN