Live data from Hacker News

Detangle: AI-generated summaries of legal docs

detangle.ai

41–50 of 105 posts

Re: Detangle: AI-generated summaries of legal docs

#41
post #8

Given how confident AI can be when it's incorrect, it feels like a bit of a problem to use AI with legal docs, since you can't really trust it to be correct (and the cost of being incorrect may be absurdly high).

As a NLP researcher at a well known place & working on this, I totally 100% agree with you, this is ultra dangerous and should not be used, straight up, on anything remotely serious

Re: Detangle: AI-generated summaries of legal docs

#42

It says all documents and summaries are deleted after 24 hours, but are the contents of the documents incorporated into a model? I'd imagine for some kinds of legal documents (say those under a court's protective order) this would present issues.

Are you able to convert the weights of a Neural Network into the training text that adjusted them?

Simply allowing someone to do this could violate the court's order, is the point. Maybe detangle should give a summary on the kind of documents it can help with and how to identify them, if it's going to pretend to be anything like a lawyer.

Re: Detangle: AI-generated summaries of legal docs

#44
post #9

What are they doing with all the uploaded document data? I didn't see that in their terms of use.

We use GPT-3 to summarize it the document data. Then 24 hours later we completely delete all text, URLs and file uploads.

No way any respectable lawyer thinks it's OK to upload a client agreement with confidential information to some fly by night website the promises to delete.

Re: Detangle: AI-generated summaries of legal docs

#45

Earlier quoted context omitted.

> even knowing what to ask a lawyer can be difficult That's the lawyer's job, to guide you through ! If they're not doing that, then find a different lawyer. The whole point is we are talking about legal document review here. Reviewing legal documents necessarily involves an active discussion with a lawyer, it is not something you can turn up with pre-prepared questions for.

That's true, but you still should (try to) be prepared. Meeting with a lawyer will go much more smoothly if you have at least a rudimentary understanding of the subject matter, rather than having them explain everything to you from first principles.

And you can also waste half the time having the lawyer explain to you that what detangle told you was wrong...

Re: Detangle: AI-generated summaries of legal docs

#48
post #24

Earlier quoted context omitted.

Given how _poorly written_ a lot of real legal documents are, I would definitely not trust any current AI to summarize it accurately. How would it handle documents where terms or clauses are in conflict, or any other situation where a close-reading human would have to step back and say "okay, this is _semantically_ impossible?" I could see a tool like this being valuable as an outline generator for long documents, bu…

I could see this being useful as a tool that scans legal documents in bulk like Terms of Service and looks for red flags that simple keyword searches would miss.

Could definitely be a useful tool to improve something like ToSDR
Post reply on HN