Live data from Hacker News

Mistral OCR

mistral.ai

221–230 of 450 posts

Re: Mistral OCR

#221

Such a shame that PDF doesn’t just, like, include the semantic structure of the document by default. It is brilliant that we standardized on an archival document format that doesn’t include direct access to the document text or structure as a core intrinsic default feature. I say this with great anger as someone who works in accessibility and has had PDF as a thorn in my side for 30 years.

Tables? I regularly run into PDFs where even the body text is mangled!

Re: Mistral OCR

#222

Nice demos but I wonder how well it does on longer files. I've been experimenting with passing some fairly neat PDFs to various LLMs for data extraction. They're created from Excel exports and some of the data is cut off or badly laid out, but it's all digitally extractable. The challenge isn't so much the OCR part, but just the length. After one page the LLMs get "lazy" and just skip bits or stop entirely. And page…

You will have to send one page at a time, most of this work has to be done via RAG. Adding a large context (like a whole PDF), still does not work that well in my experience.

Re: Mistral OCR

#223

We're approaching the point where OCR becomes "solved" — very exciting! Any legacy vendors providing pure OCR are going to get steamrolled by these VLMs. However IMO, there's still a large gap for businesses in going from raw OCR outputs —> document processing deployed in prod for mission-critical use cases. LLMs and VLMs aren't magic, and anyone who goes in expecting 100% automation is in for a surprise. You still n…

The challenge I have is how to get bounding boxes for the OCR, for things like redaction/de-identification.

Re: Mistral OCR

#224
post #142

Great progress, but unfortunately, for our use case (converting medical textbooks from PDF to MD), the results are not as good as those by MinerU/PDF-Extract-Kit [1]. Also the collab link in the article is broken, found a functional one [2] in the docs. [1] https://github.com/opendatalab/MinerU [2] https://colab.research.google.com/github/mistralai/cookbook/...

I've been searching relentlessly for something like this! I wonder why it's been so hard to find... is it the Chinese?

In any case, thanks for sharing.

Re: Mistral OCR

#225
post #43

Bit unrelated but is there anything that can help with really low resolution text? My neighbor got hit and run the other day for example, and I've been trying every tool I can to make out some of the letters/numbers on the plate https://ibb.co/mr8QSYnj

To even get started on this you'd also need to share some contextual information like continent, country etc. I'd say.

Its in CA, looks like paper plates which follow a specific format and the last two seem to be the numbers '64'. Police should be able to search for temp tag with partial match and match the make/model. Was curious to see if any software could help though

Re: Mistral OCR

#226

Such a shame that PDF doesn’t just, like, include the semantic structure of the document by default. It is brilliant that we standardized on an archival document format that doesn’t include direct access to the document text or structure as a core intrinsic default feature. I say this with great anger as someone who works in accessibility and has had PDF as a thorn in my side for 30 years.

I agree with this so much. I've tried to sometimes push friends and family to use text formats (at least I sent them something like Markdown), which is very easy to render in the browser anyways. But often you have to fall back to PDF, which I dislike very much. There's so much content like books and papers that are in PDF as well. Why did we pick a binary blob as shareable format again?

Re: Mistral OCR

#227

Such a shame that PDF doesn’t just, like, include the semantic structure of the document by default. It is brilliant that we standardized on an archival document format that doesn’t include direct access to the document text or structure as a core intrinsic default feature. I say this with great anger as someone who works in accessibility and has had PDF as a thorn in my side for 30 years.

PDF is pretty strictly modeled on printed documents and their mainstream typography at the time of invention of Postscript and so on.

Printed documents do not have any structure beyond the paper and placement of ink on them.

Re: Mistral OCR

#228
post #215
post #166

It's shocking how much our industry fails to see past its own nose. Not a single example on that page is a Purchase Order, Invoice etc. Not a single example shown is relevant to industry at scale.

Mistral is Europe based where invoices are more or less sent digitally in like 95% of all the cases anyway. Some are even digital invoices, which will at some point in the eu be mandatory. For orders there are proposals for that, too. And basically invoice data extraction is a different beast.

Can confirm, in Italy electronic invoicing is mandatory since 2019

Re: Mistral OCR

#229

Such a shame that PDF doesn’t just, like, include the semantic structure of the document by default. It is brilliant that we standardized on an archival document format that doesn’t include direct access to the document text or structure as a core intrinsic default feature. I say this with great anger as someone who works in accessibility and has had PDF as a thorn in my side for 30 years.

Even assuming you could get people to do the work (probably the real issue here) could a single schema syntax capture the semantics of the universe of documents that exist as PDFs? PDFs succeeded because they could reproduce anything.
Post reply on HN