Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

DeepDoctection: Document extraction and analysis using deep learning models

github.com

Post reply on HN
Print view View original

31–40 of 63 posts

Re: DeepDoctection: Document extraction and analysis using deep learning models

#31

Post by puika »

9dev wrote: post #30
exhibitapp wrote: post #19

I've worked extensively in this space. For those looking for just an OCR solution MSFT's offering "read" is by and far the most accurate. Key-value, table and other information extraction is a much harder problem. Anything that can go wrong in production will. Documents with extra pages, rotated, blacked out, fuzzy. There are many steps that go into making document extraction really e2e. The biggest enterprise users…

Do you have any recommendations for OCR of receipts and grocery bills? I’ve dreamt of having a little app to analyse grocery spending and distribute bills among multiple people, but every time I checked, the state of receipt OCR was surprisingly too bad for this…

Last I checked I saw a grocery bill example using https://github.com/mindee/doctr and was fairly accurate. Bear in mind that was last year, hopefully it got even better or there are other libraries

Re: DeepDoctection: Document extraction and analysis using deep learning models

#32

Post by pvitz »

exhibitapp wrote: post #19

I've worked extensively in this space. For those looking for just an OCR solution MSFT's offering "read" is by and far the most accurate. Key-value, table and other information extraction is a much harder problem. Anything that can go wrong in production will. Documents with extra pages, rotated, blacked out, fuzzy. There are many steps that go into making document extraction really e2e. The biggest enterprise users…

I would like to extract text from approximately 2000 PDF files (machine generated, not scanned) in which the layout can be different on a file basis. Some have normal paragraphs, others two columns and even three columns. All contain tables, but I am not interested in them. Do you know a good (semi-)automatic solution for this?

Re: DeepDoctection: Document extraction and analysis using deep learning models

#33

Post by flir »

ShamelessC wrote: post #25
dchuk wrote: post #6

What’s state of the art for using ML to understand html docs automatically when scraping them? I’ve tinkered with this: https://huggingface.co/docs/transformers/model_doc/markuplm and it seems useful, but ai and ml is changing so fast right now, anyone know what else is going on? An example use case: given a url, figure out content type (article vs product page for example), if product page, automatically extract all…

GPT-4 presumably.

I keep bumping in to the context window size. I'm trying to figure out a "compression" step that I can use in the general case, but nothing's very satisfying so far.

The mozilla/readability library is a good first step though.

Re: DeepDoctection: Document extraction and analysis using deep learning models

#34

Post by themantalope »

9dev wrote: post #30
exhibitapp wrote: post #19

I've worked extensively in this space. For those looking for just an OCR solution MSFT's offering "read" is by and far the most accurate. Key-value, table and other information extraction is a much harder problem. Anything that can go wrong in production will. Documents with extra pages, rotated, blacked out, fuzzy. There are many steps that go into making document extraction really e2e. The biggest enterprise users…

Do you have any recommendations for OCR of receipts and grocery bills? I’ve dreamt of having a little app to analyse grocery spending and distribute bills among multiple people, but every time I checked, the state of receipt OCR was surprisingly too bad for this…

The paddlepaddle project has nice models. Not well documented though and can be hard to use, so proceed at your own risk. But it is popular.

Re: DeepDoctection: Document extraction and analysis using deep learning models

#35

Post by j45 »

o_____________o wrote: post #11

I would pay for a simple, competent anything-to-markdown API. Something that could convert PDFs to high quality markdown with tables, etc. I'm using Document AI from Google right now and the ergonomics are awful.

Anything to markdown is broader than part to markdown

Since pdfs are created so many different ways, do you have some examples and links of the pdfs that are awful?

Re: DeepDoctection: Document extraction and analysis using deep learning models

#37

Post by whyleyc »

o_____________o wrote: post #11

I would pay for a simple, competent anything-to-markdown API. Something that could convert PDFs to high quality markdown with tables, etc. I'm using Document AI from Google right now and the ergonomics are awful.

If you just need to convert the files have you thought about using Zamzar (https://dev.zamzar.com/)?

We have a file conversion API that supports DOC/DOCX/ODT/PDF/TEX to Markdown conversion in one line of cURL (or you programming language of choice).

(Disclaimer: I'm the product lead for the Zamzar API).

Re: DeepDoctection: Document extraction and analysis using deep learning models

#38

Post by j45 »

puika wrote: post #31
9dev wrote: post #30

Earlier quoted context omitted.

Do you have any recommendations for OCR of receipts and grocery bills? I’ve dreamt of having a little app to analyse grocery spending and distribute bills among multiple people, but every time I checked, the state of receipt OCR was surprisingly too bad for this…

Last I checked I saw a grocery bill example using https://github.com/mindee/doctr and was fairly accurate. Bear in mind that was last year, hopefully it got even better or there are other libraries

This is a really helpful find thanks.

If there are any other libraries folks have seen out there like this, I’d love to try them out.

Re: DeepDoctection: Document extraction and analysis using deep learning models

#39

Post by morisy »

themantalope wrote: post #36

I’ve used this repo. It’s ok. For very simple layouts, it probably works fine. For more complex layouts it fails miserably. I’ve also had cases where it didn’t detect half the text on the page (machine generated text).

Anything you find better for complex layouts?

Re: DeepDoctection: Document extraction and analysis using deep learning models

#40

Post by newswasboring »

flir wrote: post #33
ShamelessC wrote: post #25

Earlier quoted context omitted.

GPT-4 presumably.

I keep bumping in to the context window size. I'm trying to figure out a "compression" step that I can use in the general case, but nothing's very satisfying so far. The mozilla/readability library is a good first step though.

Why do you want to compress this data? What's the final use case here?
Post reply on HN