Live data from Hacker News

Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

arstechnica.com

41–50 of 212 posts

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#41

Sigh, I'm getting very sick of hearing about how "ChatGPT" makes stuff up. Yes, 3.5 made a lot of stuff up, 4.0 still does, but it's much rarer. I wish people would mention this, it's all treated as the same thing. It's like talking about how unreliable these "Airplanes" are when they are talking about prop planes, even though jets are out.

These are generative conversation bots. Their #1 priority is to make things up.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#42
post #14
post #10

It would have taken about 1 minute to put each of them into a tool like Casetext, Lexis, WL, or Bloomberg Law to determine they didn't exist.

To do that you first need to distrust AI, and a lot of people don't. They think of GPT like Google-but-written-in-English. That is a large part of the problem.

That's not a valid excuse, though. Lawyers are paid big bucks to think, not to assume. Otherwise you could do your litigation for free by just asking interested people on Twitter. I went to law school and had to drop out due to an injury & attendant medical costs; it's a crime (as in going to jail) for me to practice law without being licensed, no matter how good my work product might be.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#44
post #19

I asked ChatGPT to tell me a riddle. It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that) I asked for a hint about 5 times and it kept giving more legitimate sounding hints. Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle. I then repeated the riddle and asked ChatGPT what the answer…

ChatGPT doesn’t know what is right or wrong.

It simply knows what the highest probability next word should be.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#45
post #2

> "Lawyer: ChatGPT said the cases were real"

Oh boy, and this one! > The plaintiff's lawyer continued to insist that the cases were real. LoDuca filed an affidavit on April 25 in which he swore to the authenticity of the fake cases

> In Shaboon v. Egyptair, 2013 IL App (1st) 111279-U.

I'm sure a case involving Egyptair is complicated, still .. I'd love to see the 111,279 page volume this citation claims to come from.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#47
post #2

> "Lawyer: ChatGPT said the cases were real"

Oh boy, and this one! > The plaintiff's lawyer continued to insist that the cases were real. LoDuca filed an affidavit on April 25 in which he swore to the authenticity of the fake cases

Doubling down on your bullshit which is itself fuelled by a robot's bullshit is a move

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#48
post #19

I asked ChatGPT to tell me a riddle. It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that) I asked for a hint about 5 times and it kept giving more legitimate sounding hints. Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle. I then repeated the riddle and asked ChatGPT what the answer…

> I asked ChatGPT to tell me a riddle. Which version of ChatGPT, if you don't mind me asking?

It was an iOS app (ChatOn) not the official app. So probably GPT-3 (edit: the app claims to use GPT-4, so not sure)

After the riddle, I bought the $20/mo subscription via the official OpenAI app to try it on GPT-4. I started by trying to play “20 questions” but we couldn’t get past 10 questions before getting an error message “rate limit exceeded, try again in an hour”

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#49
post #19

I asked ChatGPT to tell me a riddle. It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that) I asked for a hint about 5 times and it kept giving more legitimate sounding hints. Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle. I then repeated the riddle and asked ChatGPT what the answer…

Maybe the real definition of intelligence isn't being able to answer questions effectively, but being able to know what you know and know what you don't know.

There's truth to this, but in a time and place. There are times being very specific about what you know and don't know is important, but most of the time we are learning little by little, and we benefit from saying things we aren't entirely comfortable with, if only to figure out whether they are true and/or socially acceptable.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#50
At minimum the sanctions should include a fine sufficient to cover the costs of everyone who had to deal with this: the court, opposing attorneys. Maybe punitive damages too. But let the guy keep his law license (unless there's a second offense).
Post reply on HN