Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Colombian judge used ChatGPT to make court decision

vice.com

Post reply on HN
Print view View original

21–30 of 59 posts

Re: Colombian judge used ChatGPT to make court decision

#21

Post by fnordpiglet »

donmcronald wrote: post #17
fnordpiglet wrote: post #15

Earlier quoted context omitted.

If it’s making reviewed boilerplate how is it making a judgement call? Having human beings write copious tedious boilerplate isn’t good. It takes the judges mind and applies to tedium rather than using judgement. Further under tedium humans make mistakes.

> “Has the jurisprudence of the constitutional court made favorable decisions in similar cases?” That's a judgment call because "favorable" is subjective. Someone who gets sent to jail for 1 year might tell you the prosecutor got a favorable ruling while the prosecutor considers it unfavorable because they wanted the person sentenced to 5 years.

Note if you read it carefully he only included the responses but wrote parallel arguments and then synthesized the two. So, like I said, it was reviewed.

It’s like complaining engineers use Monte Carlo simulations, which are random, to do analyses of structural integrity instead of doing all the calculations using a human computer[1]. I see these LLM chatbots as being akin to a computational tool like a calculator. It’s great for crunching and provides a force multiplier for a skilled person using it to augment their own abilities, but it’s (not yet) a replacement for the expert.

[1] https://en.m.wikipedia.org/wiki/Computer_(occupation)

Re: Colombian judge used ChatGPT to make court decision

#22

Post by fnordpiglet »

rapsey wrote: post #9
8note wrote: post #4

Oh interesting. I didn't realize chatgpt works in multiple languages

Not only that it is probably the best translation engine ever made. It translates incredibly well. This is likely one of the industries that is going to be hit severely.

It’s able to translate dead languages reasonably well, too. I asked it to translate various text into Pali and it did a good job, and did a reasonable job providing the text of various Buddhist sutta and decent translations into English.

Re: Colombian judge used ChatGPT to make court decision

#23

Post by jkaplowitz »

hef19898 wrote: post #20
giancarlostoro wrote: post #14

Earlier quoted context omitted.

This is how I use chatgpt. “Write me an email explaining to stakeholders that we have x” and then I mention as much detail and whatever it spits out I tweak and go from there. I have been told I write amazing emails but my problem is I spend a lot of time thinking my email over way too much, so I like to see how condensed chatgpt gives me of a template so I can reuse it. I often take a five paragraph email and conden…

I would honestely have doubts giving an unvetted third party, openai through ChatGPT, access to any prorietery or business relevant information.

Agreed. One could however use a nonconfidential placeholder for the sensitive information and then replace it with the real information while revising the ChatGPT output.

Re: Colombian judge used ChatGPT to make court decision

#24

Post by Idk__Throwaway »

hef19898 wrote: post #20
giancarlostoro wrote: post #14

Earlier quoted context omitted.

This is how I use chatgpt. “Write me an email explaining to stakeholders that we have x” and then I mention as much detail and whatever it spits out I tweak and go from there. I have been told I write amazing emails but my problem is I spend a lot of time thinking my email over way too much, so I like to see how condensed chatgpt gives me of a template so I can reuse it. I often take a five paragraph email and conden…

I would honestely have doubts giving an unvetted third party, openai through ChatGPT, access to any prorietery or business relevant information.

Yeah I've seen a lot of people who seem to believe that the prompts they give ChatGPT aren't being cataloged and saved when they certainly are.

It sends every prompt you give it to a server, by design it has to as the model is far too computationally expensive to run locally.

Re: Colombian judge used ChatGPT to make court decision

#25

Post by jkaplowitz »

maxbond wrote: post #7
clbrmbr wrote: post #2

Could be interesting to use embeddings so you could get proper legal citations. This could be a great leveler, making it easier to self-represent…

Here's a video from Legal Eagle on the topic from yesterday: https://youtu.be/Tpq3hRt0pmw Tl;Dw it's a cold shower on this idea as it's implemented by the startup DoNotPay. There are a myriad of issues but the biggest one is that it isn't possible to foist the liability onto the customer and thus skirt the regulations around the unlicensed practice of law - if you run this service, you are either a law firm or you ar…

Not all countries comprehensively forbid the unlicensed practice of law - one prominent exception is England, where only a specific set of reserved legal activities require authorization:

https://legalservicesboard.org.uk/enquiries/frequently-asked...

So a service like this would probably be legal there if they avoid the reserved activities.

Re: Colombian judge used ChatGPT to make court decision

#26

Post by whatgoodisaroad »

There's a way of looking at this as pretty much normal. I think we have yet to really face the fact that systems of common-law are ad-hoc LLMs (in contrast to statutory-law, which is more similar to standard programming).

In particular, common-law uses an enormous "model" of case precedents that gets incrementally updated by human curators with minimal influence over it.

Re: Colombian judge used ChatGPT to make court decision

#27

Post by tropicaljacket »

> Although the Colombian court filing indicates that ... its responses were fact-checked

The problem is that the fact-checkers themselves can make mistakes and chatGPT is very good at making text that looks correct, even to experts. See the Meta StackOverflow post on banning ChatGPT answers for example

Post reply on HN