I would pay for a simple, competent anything-to-markdown API. Something that could convert PDFs to high quality markdown with tables, etc. I'm using Document AI from Google right now and the ergonomics are awful.
DeepDoctection: Document extraction and analysis using deep learning models
11–20 of 63 posts
Re: DeepDoctection: Document extraction and analysis using deep learning models
#12Earlier quoted context omitted.
Not sure what your budget is but I’ve used AWS for handling PDFs and it’s been pretty good at detecting content via boundary boxes.
AWS as in Amazon Web Services? And if so, can you be more specific?
Here are some more options:
* AWS Textract [0]
* Microsoft Azure [1]
* Google Cloud Vision [2]
I personally use Azure, combined with OCR correction using GPT to convert a scan of my daily journal (Apple Notes creates a PDF that is nothing but a bunch of images) -> Markdown -> Extract tasks and then add them to my Reminders app using CalDav. Azure has one of the best OCR for handwritten text, but for normal document extraction (read: printed text), any service would do a reasonable job.
[0] https://docs.aws.amazon.com/prescriptive-guidance/latest/pat...
[1] https://learn.microsoft.com/en-us/azure/data-factory/solutio...
Re: DeepDoctection: Document extraction and analysis using deep learning models
#13Isn't it depressing, that we live in 2023 and the predominant document format is pdf, which was invented in 1993 and is optimized for printing? I would love to have a new format, which is easily parseable (like JSON) AND printable (like PDF).
Asciidoc, HTMLbook, Docbook are the standards O'Reilly media using to create their books (and PDFs).
No need to reinvent the wheel there.
Re: DeepDoctection: Document extraction and analysis using deep learning models
#14I was just looking for OCR. How does this compare with easyOCR?
For what its worth, very high quality OCR from Google's Vision offering costs $0.0015 per page, with 1000 free pages per month. In my experience, it has been signficantly superior to any open source solution.
Re: DeepDoctection: Document extraction and analysis using deep learning models
#15Re: DeepDoctection: Document extraction and analysis using deep learning models
#16I was just looking for OCR. How does this compare with easyOCR?
For what its worth, very high quality OCR from Google's Vision offering costs $0.0015 per page, with 1000 free pages per month. In my experience, it has been signficantly superior to any open source solution.
Why this over Document AI?
Re: DeepDoctection: Document extraction and analysis using deep learning models
#17Isn't it depressing, that we live in 2023 and the predominant document format is pdf, which was invented in 1993 and is optimized for printing? I would love to have a new format, which is easily parseable (like JSON) AND printable (like PDF).
at least PDF occasionally contains actual text. My organisation systematically scans everything to TIFF images for archival. So now we are embarking on a major project to OCR the TIFFs to get back the text (!).
My payroll statement is the same, image wrapped in a pdf document.
I’m not sure if they’re being intentionally annoying or if someone thought this was actually helpful for the thousands of independent contractors who track their expenses down to the penny?
Re: DeepDoctection: Document extraction and analysis using deep learning models
#18Isn't it depressing, that we live in 2023 and the predominant document format is pdf, which was invented in 1993 and is optimized for printing? I would love to have a new format, which is easily parseable (like JSON) AND printable (like PDF).
I thinks it’s depressing that we’re still thinking of content being containerised as if it still had to be bound in a physical volume instead of being addressable items of information, like a computer naturally stores information.
Re: DeepDoctection: Document extraction and analysis using deep learning models
#19I've worked extensively in this space. For those looking for just an OCR solution MSFT's offering "read" is by and far the most accurate. Key-value, table and other information extraction is a much harder problem. Anything that can go wrong in production will. Documents with extra pages, rotated, blacked out, fuzzy. There are many steps that go into making document extraction really e2e.
The biggest enterprise users are doing thousand+ of pages a minute and also turn document extraction into a scaling distributed systems problem
Re: DeepDoctection: Document extraction and analysis using deep learning models
#20I've worked extensively in this space. For those looking for just an OCR solution MSFT's offering "read" is by and far the most accurate. Key-value, table and other information extraction is a much harder problem. Anything that can go wrong in production will. Documents with extra pages, rotated, blacked out, fuzzy. There are many steps that go into making document extraction really e2e. The biggest enterprise users…
Do they have human workers for those hard to solve cases in the loop?