Wait, this is handled as "ChatGPT made up these cases" and not as "Layers deliberately used ChatGPT to fabricate stuff"? Is anyone really believing a lawyer is that stupid? I know, adssume good intentions and all, but in this case, really?
Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
191–200 of 212 posts
Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
#192Earlier quoted context omitted.
It seems that you don't know what you don't know, really. There's no way to definitively know what properties ChatGPT has. It does seem to reason to some extent and it does often say that some information isn't known/there's no data. And it almost obnoxiously often tells you that it's simplifying a complex and multifaceted situation.
Its a model that takes an input and spits out the most likely output given its training. "There's no way to definitively know what properties ChatGPT has." - yes there is: ask it how the war in Ukraine is progressing or some other time based thing. It stops in 2021. It is a really useful tool but it isn't sentient.
Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
#193Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
#194Earlier quoted context omitted.
It's not a person, it's a machine. And it's one that will still produce hallucinations that embarrassingly prove that it has no notion of intelligence, and do so confidently. That it does so less than it's sibling is entirely irrelevant.
Nope, wrong. The number of errors and the magnitude of each is very relevant.
Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
#195Earlier quoted context omitted.
GPT does nothing but predict the next word (token, to be more exact). If you ask it for hints, it's going to come up with some hints that sound like they could be plausible in context of the original riddle. If you then ask it what the answer was, it's going to try to take all the earlier hints into account, because that's now the text it's trying to complete. There's no entity sitting on the other side of the screen…
> You should expect similar results as if it was bunch of people passing a single piece of paper to each other, each writing a single word on it, not communicating with each other in any other way and trying their best to come up with coherent result. I'm pretty sure GPT-4's context window is bigger than '1 token'.
It still generates one token at a time and can't backtrack afterwards.
Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
#196Earlier quoted context omitted.
A very intelligent person can simultaneously be very stupid, and stupid behavior can be increased with tight deadlines or a high workload.
It was his first try with the tech. He should have popped the cases into West Law and at least skimmed the briefs, he is at a big firm with that subscription. I'm not a lawyer and I at least have a clue for the legal research shortcuts. This guy must have been drinking and or having an affair to have pit so little effort into his first try using a new tech. I'm guessing there is a risk of humorous legal parody gettin…
If he thinks it is like querying a database and had never heard of hallucinations then this could just be an honest mistake. Especially if he thinks AI would be smarter than a database.
My first thought that he was a mess in general but we really don't have enough information. Like the other guy saying he cheated in life, it is pretty absurd to infer that.
Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
#197Sigh, I'm getting very sick of hearing about how "ChatGPT" makes stuff up. Yes, 3.5 made a lot of stuff up, 4.0 still does, but it's much rarer. I wish people would mention this, it's all treated as the same thing. It's like talking about how unreliable these "Airplanes" are when they are talking about prop planes, even though jets are out.
Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
#198Wait, this is handled as "ChatGPT made up these cases" and not as "Layers deliberately used ChatGPT to fabricate stuff"? Is anyone really believing a lawyer is that stupid? I know, adssume good intentions and all, but in this case, really?
I believe some lawyers are that stupid. I also believe lawyers who are stupid enough not to verify ChatGPT's responses should be treated as if they willfully lied to the court. "Oops, I didn't know" is a good defence when you're caught accidentally walking on the grass, not when you're in court.
Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
#199Earlier quoted context omitted.
I've had a few moments with ChatGPT that are great anecdotes similar to your own: - Asked it to generate a MadLib for me to play that was no more than a paragraph long. It produced something that was several paragraphs wrong. I told it "no. That's X paragraphs. I asked for one that is only 1 paragraph long" and it would respond "I'm sorry for the misunderstanding. Let me try again" and then would make the same mistak…
Did you really expect ChatGPT to be a full blown dungeon master?
Re: Lawyer cited 6 fake cases made up by ChatGPT; judge calls it “unprecedented”
#200Earlier quoted context omitted.
The lawyer didn't use ChatGPT to purposefully fabricate cases, he just relied on GPT and assumed it wasn't lying.
How do you know this?