Live data from Hacker News

Answering Legal Questions with LLMs

hugodutka.com

11–20 of 160 posts

Re: Answering Legal Questions with LLMs

#11

GPT-4 also cannot solve full programming problems, and frequently makes large errors even with a small focused context, as in Github Copilot Chat. However, it is still extremely useful and productivity enhancing. When combined with the right workflow and UI. Programming is large enough of an industry, that has Microsoft building it out in VScode. I don't think the legal industry has a similar tool. Also, I think prog…

Lawyers can also be held professionally liable if they get things wrong.

Re: Answering Legal Questions with LLMs

#12

Many laws, especially GDPR, can only be interpreted in conjunction with a lot of guidelines (WP29 for example), interpretations by the local Data Protection Authority, decisions by local and European courts, etc. Given all of this information, I think the bot will be able to formulate and answer. However, the bot first needs to know what information is needed. If a lawyer has to feed the bot certain specific parts of…

I'm surprised Gemini 1.5 isn't getting more attention. Despite being marginally worse than the leaders, its still solid and you can dump 975,000 (!) tokens into it and still have ~75,000 to play with.

I've been using it lately for microcontoller coding, and I can just dump the whole 500 page MCU reference manual into it before starting, and it gives tailored code for the specific MCU I am using. Total game changer.

Re: Answering Legal Questions with LLMs

#13

GPT-4 also cannot solve full programming problems, and frequently makes large errors even with a small focused context, as in Github Copilot Chat. However, it is still extremely useful and productivity enhancing. When combined with the right workflow and UI. Programming is large enough of an industry, that has Microsoft building it out in VScode. I don't think the legal industry has a similar tool. Also, I think prog…

Lawyers can also be held professionally liable if they get things wrong.

I’ll probably get downvoted to oblivion, but I wish it were the same for software engineers (not programmers, or developers though — but people who explicitly label themselves or be labeled as “engineers”).

Re: Answering Legal Questions with LLMs

#14

Many laws, especially GDPR, can only be interpreted in conjunction with a lot of guidelines (WP29 for example), interpretations by the local Data Protection Authority, decisions by local and European courts, etc. Given all of this information, I think the bot will be able to formulate and answer. However, the bot first needs to know what information is needed. If a lawyer has to feed the bot certain specific parts of…

I'm surprised Gemini 1.5 isn't getting more attention. Despite being marginally worse than the leaders, its still solid and you can dump 975,000 (!) tokens into it and still have ~75,000 to play with. I've been using it lately for microcontoller coding, and I can just dump the whole 500 page MCU reference manual into it before starting, and it gives tailored code for the specific MCU I am using. Total game changer.

[dead]

Re: Answering Legal Questions with LLMs

#15

A tool like this should live in service to the legal profession. Like Copilot, without a human verifying, improving, and maintaining the work, it is risky (possibly negligent) to provide this service to end users.

This service may have been better with a higher context window but with the required accuracy of legal document writing the inaccuracy of the RAG systems are too high.

Also, people have actually used it in practice and it didn’t go that well. So human in the loop systems in practice should have users finding corrections but won’t occur when you release the product.

https://qz.com/chat-gpt-open-ai-legal-cases-1851214411

Re: Answering Legal Questions with LLMs

#16

Many laws, especially GDPR, can only be interpreted in conjunction with a lot of guidelines (WP29 for example), interpretations by the local Data Protection Authority, decisions by local and European courts, etc. Given all of this information, I think the bot will be able to formulate and answer. However, the bot first needs to know what information is needed. If a lawyer has to feed the bot certain specific parts of…

I'm surprised Gemini 1.5 isn't getting more attention. Despite being marginally worse than the leaders, its still solid and you can dump 975,000 (!) tokens into it and still have ~75,000 to play with. I've been using it lately for microcontoller coding, and I can just dump the whole 500 page MCU reference manual into it before starting, and it gives tailored code for the specific MCU I am using. Total game changer.

Is the resulting (C) code maintainable, unit testable, do you understand it? If your answer is "I'll just ask gemini to explain it", I will laugh sarcastically and then sob for the poor people around the hardware you program for

Re: Answering Legal Questions with LLMs

#17
The next step after this is more complicated laws because lawyers can now use LLMs, and thus laws even more opaque to ordinary folk who will have to use LLMs to understand anything. It's an even more fragile system that will undoubtedly be in favour of those who can wield the most powerful LLM, or in other words, the rich and the corporations.

This is another example of technology making things temporarily easier, until the space is filled with an equal dose of complexity. It is Newton's third law for technological growth: if technology asserts a force to make life simpler, society will fill that void with an equal force in the opposite direction to make it even more complex.

Re: Answering Legal Questions with LLMs

#19

Earlier quoted context omitted.

My number one request is still: "please rewrite this legal answer in simple language with short sentences." For this, it is amazing (as long as I proofread the result). For actual answers, eh...

I assume you're in the legal profession? Do you find, as you proofread, that you want to insert caveats and qualifiers into the "simple" language and end up with something like the original legalese? Legal language is what it is in large part because simple short sentences are too imprecise to express the detail needed.

Indeed, a corrolary in computer science is the the reasoning behind why using the Go programming language is, in general, a major mistake.

Simple vocabularies, while attractive will inevitably fail to properly describe systems of any sufficient complexity without long chains of hard to follow low-level logic.

Any system of sufficient complexity necessitates the use of more complex vocabulary to capture all the nuances of the system. See: Legalese, medical jargon, chemical naming schemes, the existence of mathematics itself, etc..

Re: Answering Legal Questions with LLMs

#20

The next step after this is more complicated laws because lawyers can now use LLMs, and thus laws even more opaque to ordinary folk who will have to use LLMs to understand anything. It's an even more fragile system that will undoubtedly be in favour of those who can wield the most powerful LLM, or in other words, the rich and the corporations. This is another example of technology making things temporarily easier, un…

Lmao dont make up laws like that please. If anything my guess is that LLMs will make laws simpler and without loopholes and rich people wont be able to hire lawyers to have a competitive advantage in exploiting legal loopholes
Post reply on HN