Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

DeepDoctection: Document extraction and analysis using deep learning models

github.com

Post reply on HN
Print view View original

21–30 of 63 posts

Re: DeepDoctection: Document extraction and analysis using deep learning models

#21

Post by idealism »

exhibitapp wrote: post #19

I've worked extensively in this space. For those looking for just an OCR solution MSFT's offering "read" is by and far the most accurate. Key-value, table and other information extraction is a much harder problem. Anything that can go wrong in production will. Documents with extra pages, rotated, blacked out, fuzzy. There are many steps that go into making document extraction really e2e. The biggest enterprise users…

A few days ago, IBM announced a new OCR system[1]. Have you by chance compared it to Microsoft's offering? I'm currently looking for the best-in-class OCR solution for scanned PDF documents.

[1]: https://www.ibm.com/cloud/blog/exploring-ibms-new-optical-ch...

Re: DeepDoctection: Document extraction and analysis using deep learning models

#22

Post by gcr »

o_____________o wrote: post #11

I would pay for a simple, competent anything-to-markdown API. Something that could convert PDFs to high quality markdown with tables, etc. I'm using Document AI from Google right now and the ergonomics are awful.

ABBYY reader is a fine human-in-the-loop solution. It can at least output from PDF to ePub, and you can imagine going to markdown from there.

Re: DeepDoctection: Document extraction and analysis using deep learning models

#23

Post by swsieber »

navanchauhan wrote: post #12
anamexis wrote: post #10

Earlier quoted context omitted.

AWS as in Amazon Web Services? And if so, can you be more specific?

Here are some more options: * AWS Textract [0] * Microsoft Azure [1] * Google Cloud Vision [2] I personally use Azure, combined with OCR correction using GPT to convert a scan of my daily journal (Apple Notes creates a PDF that is nothing but a bunch of images) -> Markdown -> Extract tasks and then add them to my Reminders app using CalDav. Azure has one of the best OCR for handwritten text, but for normal document e…

Could you explain how you use GPT for ocr correction?

Re: DeepDoctection: Document extraction and analysis using deep learning models

#24

Post by navanchauhan »

swsieber wrote: post #23
navanchauhan wrote: post #12

Earlier quoted context omitted.

Here are some more options: * AWS Textract [0] * Microsoft Azure [1] * Google Cloud Vision [2] I personally use Azure, combined with OCR correction using GPT to convert a scan of my daily journal (Apple Notes creates a PDF that is nothing but a bunch of images) -> Markdown -> Extract tasks and then add them to my Reminders app using CalDav. Azure has one of the best OCR for handwritten text, but for normal document e…

Could you explain how you use GPT for ocr correction?

https://promptbase.com/prompt/ocr-text-fixer

This is the prompt I bought from promptbase. You basically provide GPT with some examples on possible OCR errors, and then you give it the OCRed text and it tries to correct it

Re: DeepDoctection: Document extraction and analysis using deep learning models

#25

Post by ShamelessC »

dchuk wrote: post #6

What’s state of the art for using ML to understand html docs automatically when scraping them? I’ve tinkered with this: https://huggingface.co/docs/transformers/model_doc/markuplm and it seems useful, but ai and ml is changing so fast right now, anyone know what else is going on? An example use case: given a url, figure out content type (article vs product page for example), if product page, automatically extract all…

GPT-4 presumably.

Re: DeepDoctection: Document extraction and analysis using deep learning models

#26

Post by alsodumb »

idealism wrote: post #21
exhibitapp wrote: post #19

I've worked extensively in this space. For those looking for just an OCR solution MSFT's offering "read" is by and far the most accurate. Key-value, table and other information extraction is a much harder problem. Anything that can go wrong in production will. Documents with extra pages, rotated, blacked out, fuzzy. There are many steps that go into making document extraction really e2e. The biggest enterprise users…

A few days ago, IBM announced a new OCR system[1]. Have you by chance compared it to Microsoft's offering? I'm currently looking for the best-in-class OCR solution for scanned PDF documents. [1]: https://www.ibm.com/cloud/blog/exploring-ibms-new-optical-ch...

Call me biased, but I've learned over time that anything that comes out of the Waston team looks good only in PR statements but sucks at production - especially at tasks like OCR. YMMV.

Re: DeepDoctection: Document extraction and analysis using deep learning models

#27

Post by Baeocystin »

zmmmmm wrote: post #8
tevlon wrote: post #4

Isn't it depressing, that we live in 2023 and the predominant document format is pdf, which was invented in 1993 and is optimized for printing? I would love to have a new format, which is easily parseable (like JSON) AND printable (like PDF).

at least PDF occasionally contains actual text. My organisation systematically scans everything to TIFF images for archival. So now we are embarking on a major project to OCR the TIFFs to get back the text (!).

Considering the data format hells I've had to deal with over the years, straightforward TIFF scans don't sound so bad, honestly.

Re: DeepDoctection: Document extraction and analysis using deep learning models

#28

Post by esquire_900 »

dchuk wrote: post #6

What’s state of the art for using ML to understand html docs automatically when scraping them? I’ve tinkered with this: https://huggingface.co/docs/transformers/model_doc/markuplm and it seems useful, but ai and ml is changing so fast right now, anyone know what else is going on? An example use case: given a url, figure out content type (article vs product page for example), if product page, automatically extract all…

Probably a URL and title and perhaps a bit of readable content would be enough for chatgpt 3 to classify the page type.

There was a show HN here a couple of days ago that used chatgpt to create a scraper based on a webpage. Hook the 2 together and you are basically there!

Re: DeepDoctection: Document extraction and analysis using deep learning models

#30

Post by 9dev »

exhibitapp wrote: post #19

I've worked extensively in this space. For those looking for just an OCR solution MSFT's offering "read" is by and far the most accurate. Key-value, table and other information extraction is a much harder problem. Anything that can go wrong in production will. Documents with extra pages, rotated, blacked out, fuzzy. There are many steps that go into making document extraction really e2e. The biggest enterprise users…

Do you have any recommendations for OCR of receipts and grocery bills? I’ve dreamt of having a little app to analyse grocery spending and distribute bills among multiple people, but every time I checked, the state of receipt OCR was surprisingly too bad for this…
Post reply on HN