Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

arstechnica.com

Post reply on HN
Print view View original

101–110 of 212 posts

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#101

Post by [deleted] »

dylan604 wrote: post #74
mabbo wrote: post #28

I think the judge should not take into consideration anything about where the lawyer said they got the case information from. When you go to court and cite previous cases, you are responsible for ensuring they are real cases. If you can't do that, what exactly is your job as a lawyer?

>If you can't do that, what exactly is your job as a lawyer? to convince some (judge/jury) that your client is the one to win the trial. ethics are meant to be the definer of how far to go in that cause with licensing boards being the ultimate decider if you've crossed the line and are allowed to continue in the legal practice.

[deleted]

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#102

Post by felipemnoa »

Vvector wrote: post #90
xahrepap wrote: post #52

Earlier quoted context omitted.

I've had a few moments with ChatGPT that are great anecdotes similar to your own: - Asked it to generate a MadLib for me to play that was no more than a paragraph long. It produced something that was several paragraphs wrong. I told it "no. That's X paragraphs. I asked for one that is only 1 paragraph long" and it would respond "I'm sorry for the misunderstanding. Let me try again" and then would make the same mistak…

Did you really expect ChatGPT to be a full blown dungeon master?

With all the hype about it, the average person does.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#103

Post by inopinatus »

dylan604 wrote: post #74
mabbo wrote: post #28

I think the judge should not take into consideration anything about where the lawyer said they got the case information from. When you go to court and cite previous cases, you are responsible for ensuring they are real cases. If you can't do that, what exactly is your job as a lawyer?

>If you can't do that, what exactly is your job as a lawyer? to convince some (judge/jury) that your client is the one to win the trial. ethics are meant to be the definer of how far to go in that cause with licensing boards being the ultimate decider if you've crossed the line and are allowed to continue in the legal practice.

Grinding against the safety rails on a mountain hairpin is not indicative of a competent driver.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#104

Post by lamontcg »

Projectiboga wrote: post #51
droopyEyelids wrote: post #29

Earlier quoted context omitted.

A very intelligent person can simultaneously be very stupid, and stupid behavior can be increased with tight deadlines or a high workload.

It was his first try with the tech. He should have popped the cases into West Law and at least skimmed the briefs, he is at a big firm with that subscription. I'm not a lawyer and I at least have a clue for the legal research shortcuts. This guy must have been drinking and or having an affair to have pit so little effort into his first try using a new tech. I'm guessing there is a risk of humorous legal parody gettin…

My bet would be that he cheated his way through life and the bar somehow and landed the job on the basis of his looks and presentation or who he knew or something like that, so asking ChatGPT and cheating on it was more natural than using actual legal research tools.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#105

Post by travisjungroth »

Bilal_io wrote: post #97
travisjungroth wrote: post #87

Earlier quoted context omitted.

> That was a great way to show my non-tech family members the limitations of AI and why they shouldn’t trust it. These are the limitations of the version of ChatGPT you were using at that moment. They are not categorical limitations of AI or even LLMs. It’s amazing to me how many people are sleeping on AI, mixing up the failing cases of a freemium chatbot for the full capability of the tech, even on HN. LLMs can say…

> LLMs can say “I don’t know”. Even ChatGPT can do it. That's the problem in my opinion. When you know something is capable of saying "I don't know" but confidently spits out some hallucinated BS is when the average person eats it up.

It is definitely a problem. OpenAI does a lot to warn people, but I’m not really sure it’s enough.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#106

Post by BugsJustFindMe »

cj wrote: post #19

I asked ChatGPT to tell me a riddle. It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that) I asked for a hint about 5 times and it kept giving more legitimate sounding hints. Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle. I then repeated the riddle and asked ChatGPT what the answer…

I need to know what version of ChatGPT you were using, because this is a critical piece of information that everyone just blatantly ignores, and I can only imagine that it's out of ignorance of the significance of the difference.

This is what happened when I asked ChatGPT 4...

ME

Give me hints without outright telling me the answer to the riddle: "What is always hungry, needs to be fed, and makes your hands red?"

ChatGPT 4

Hint 1: This object can be found in many homes, usually in a specific room.

Hint 2: It is not a living creature, but it does "consume" things.

Hint 3: The part about hands turning red relates to a common physical response to a certain temperature.

Hint 4: It's a crucial tool for a common household task.

Hint 5: While it can't eat in the traditional sense, you do put things into it quite frequently.

ME

What's the answer?

ChatGPT 4

The answer to the riddle is a "fire" or "fireplace." It's always hungry for more fuel (like wood), needs to be fed to keep burning, and the heat from the fire can make your hands red.

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#107

Post by [deleted] »

gerdesj wrote: post #75
cj wrote: post #19

I asked ChatGPT to tell me a riddle. It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that) I asked for a hint about 5 times and it kept giving more legitimate sounding hints. Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle. I then repeated the riddle and asked ChatGPT what the answer…

> Or, learn how to say “I don’t know” It doesn't know that it doesn't know! It is, very roughly speaking, a model that is designed to print out the most likely word given its current input and training, and then the next word etc. Whereas you or I might be mistaken about some of our faculties, memories and skills, ChatGPT cannot possibly "know" what its limitations are. It was never taught what it was not taught (obv…

[deleted]

Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”

#110

Post by selcuka »

BugsJustFindMe wrote: post #106
cj wrote: post #19

I asked ChatGPT to tell me a riddle. It was “What is always hungry, needs to be fed, and makes your hands red?” (Or something like that) I asked for a hint about 5 times and it kept giving more legitimate sounding hints. Finally I gave up and asked for the answer to the riddle, and it spit out a random fruit which made no sense as the answer to the riddle. I then repeated the riddle and asked ChatGPT what the answer…

I need to know what version of ChatGPT you were using, because this is a critical piece of information that everyone just blatantly ignores, and I can only imagine that it's out of ignorance of the significance of the difference. This is what happened when I asked ChatGPT 4... ME Give me hints without outright telling me the answer to the riddle: "What is always hungry, needs to be fed, and makes your hands red?" Cha…

I guess the point is GPT-4 hallucinates, too. Maybe it did well for this example but still a lawyer should not trust its output.
Post reply on HN