When I see this type of titles, before reading I first stop by the comments to see if someone found any BS. Most times someone did, so I skip. Thank you, BS checkers.
GPT-5 outperforms federal judges in legal reasoning experiment
121–130 of 254 posts
Re: GPT-5 outperforms federal judges in legal reasoning experiment
#122Earlier quoted context omitted.
Yeah, I'm reminded of the various child porn cases where the "perpetrator" is a stupid teenager who took nude pics of themselves and sent them to their boy/girlfriend. Many of those cases have been struck down by judges because the letter of the law creates a non-sequitur where the teenager is somehow a felon child predator who solely preyed on themselves, and sending them to jail and forcing them to sign up for a se…
Sorry but that seems like an insane system where whole classes of actions effectively are illegal but probably okay if you're likeable. In your scenario the obvious solution is to amend the law and pardon people convinced under it. B/c what really happens is that if you have a pretty face and big tits you get out of speeding tickets b/c "gosh well the law wasn't intended for nice people like you"
Are you even responding to the right comment? I read your comment and the parent comment you've responded to and this response doesn't make sense - it reads like a non-sequitur.
Re: GPT-5 outperforms federal judges in legal reasoning experiment
#123Earlier quoted context omitted.
This is one of the roles of justice, but it is also one of the reasons why wealthy people are convicted less often. While it often delivered as a narrative of wealth corrupting the system, the reality is that usually what they are buying is the justice that we all should have. So yes, a judge can let a stupid teenager off on charges of child porn selfies. but without the resources, they are more likely be told by a p…
Oddly enough, Texas passed reform to keep sexting teens from getting prosecuted when: they are both under 18 and less than two years difference in age. It was regarded as a model for other states. It's the only positive thing I have heard of Texas legislating wrt sexuality.
Lawmakers have teenagers in their own families, apparently. Not just someone else's problem.
Re: GPT-5 outperforms federal judges in legal reasoning experiment
#124IANAL, but this seems like an odd test to me. Judges do what their name implies - make judgment calls. I find it re-assuring that judges get different answers under different scenarios, because it means they are listening and making judgment calls. If LLMs give only one answer, no matter what nuances are at play, that sounds like they are failing to judge and instead are diminishing the thought process down to black-…
There are findings of fact (what happened, context) and findings of law (what does the law mean given the facts). I don't think inconsistentcy in findings of law is acceptable, really. If laws are bad fix the laws or have precident applied uniformly rather than have individual random judges invent new laws from the bench. Sentencing is a different thing.
[deleted]
Re: GPT-5 outperforms federal judges in legal reasoning experiment
#125IANAL, but this seems like an odd test to me. Judges do what their name implies - make judgment calls. I find it re-assuring that judges get different answers under different scenarios, because it means they are listening and making judgment calls. If LLMs give only one answer, no matter what nuances are at play, that sounds like they are failing to judge and instead are diminishing the thought process down to black-…
There are findings of fact (what happened, context) and findings of law (what does the law mean given the facts). I don't think inconsistentcy in findings of law is acceptable, really. If laws are bad fix the laws or have precident applied uniformly rather than have individual random judges invent new laws from the bench. Sentencing is a different thing.
Leeway for human interpretation of laws is not a bug, it's a feature. It doesn't make things bad laws.
This was the whole problem with the ludicrous "code is law!" movement a handful of years ago. No, it's not, law is made for people, life is imprecise and fairness and decency are not easy to encode.
Re: GPT-5 outperforms federal judges in legal reasoning experiment
#126Earlier quoted context omitted.
Yeah, I'm reminded of the various child porn cases where the "perpetrator" is a stupid teenager who took nude pics of themselves and sent them to their boy/girlfriend. Many of those cases have been struck down by judges because the letter of the law creates a non-sequitur where the teenager is somehow a felon child predator who solely preyed on themselves, and sending them to jail and forcing them to sign up for a se…
This example feels more like a bug in the law itself that should be corrected. If this behavior is acceptable then it should be legal so we can avoid everyone the hassle in the first place. I bet AI would be great at finding and fixing these bugs.
Start fixing those bugs, you will open up can after can of worms.
Finding the bugs- will be entertaining.
Re: GPT-5 outperforms federal judges in legal reasoning experiment
#127The fact that the most elite judges in the land, those of the Supreme Court, disagree so extremely and so routinely really says a lot about the farcical nature of the judicial system. Ideally, these people would be selected for their ice-cold and unbiased skills in interpreting the law, and the judgments would be unanimous so frequently that a dissent would be shocking news.
Law is complicated, especially the requirement that existing law be combined with stare decisis. It's easy to see how an LLM could dog-walk a human judge if a judgement is purely a matter of executing a set of logical rules.
If LLMs are capable of performing this feat, frankly I think it would be appropriate to think about putting the human law interpreters out to pasture. However, for those who are skeptical of throwing LLMs at everything (and I'm definitely one of these): this will most definitely be the thing that triggers the Butlerian Jihad. An actual unbiased legal system would be an unaccptable threat to the privileges of the ruling class.
Re: GPT-5 outperforms federal judges in legal reasoning experiment
#128The fact that the most elite judges in the land, those of the Supreme Court, disagree so extremely and so routinely really says a lot about the farcical nature of the judicial system. Ideally, these people would be selected for their ice-cold and unbiased skills in interpreting the law, and the judgments would be unanimous so frequently that a dissent would be shocking news. Law is complicated, especially the require…
The law isn't a series of "if... then..." statements. It's a collection of vagueries and categorizations that are wholly open to interpretation of when and who they apply to. Add to that, sometimes they are in conflict with each other.
Judges jobs are to use they judgement.
Re: GPT-5 outperforms federal judges in legal reasoning experiment
#129Earlier quoted context omitted.
Yeah, I'm reminded of the various child porn cases where the "perpetrator" is a stupid teenager who took nude pics of themselves and sent them to their boy/girlfriend. Many of those cases have been struck down by judges because the letter of the law creates a non-sequitur where the teenager is somehow a felon child predator who solely preyed on themselves, and sending them to jail and forcing them to sign up for a se…
This example feels more like a bug in the law itself that should be corrected. If this behavior is acceptable then it should be legal so we can avoid everyone the hassle in the first place. I bet AI would be great at finding and fixing these bugs.
Fair, but still, the legislative process takes alot of time, and judicial norms and precedent allow for discretion to be exercised with accountability, which also informs the legislative process.
Re: GPT-5 outperforms federal judges in legal reasoning experiment
#130Earlier quoted context omitted.
Sorry but that seems like an insane system where whole classes of actions effectively are illegal but probably okay if you're likeable. In your scenario the obvious solution is to amend the law and pardon people convinced under it. B/c what really happens is that if you have a pretty face and big tits you get out of speeding tickets b/c "gosh well the law wasn't intended for nice people like you"
Are you even responding to the right comment? I read your comment and the parent comment you've responded to and this response doesn't make sense - it reads like a non-sequitur.
People like this don’t let the facts get in the way.