DeepDoctection: Document extraction and analysis using deep learning models • Hacker News Board

Re: DeepDoctection: Document extraction and analysis using deep learning models

#61

Post by o_____________o » Thu, Apr 27, 2023, 10:23 PM UTC

whyleyc wrote: post #37

o_____________o wrote: post #11

I would pay for a simple, competent anything-to-markdown API. Something that could convert PDFs to high quality markdown with tables, etc. I'm using Document AI from Google right now and the ergonomics are awful.

If you just need to convert the files have you thought about using Zamzar ( https://dev.zamzar.com/ )? We have a file conversion API that supports DOC/DOCX/ODT/PDF/TEX to Markdown conversion in one line of cURL (or you programming language of choice). (Disclaimer: I'm the product lead for the Zamzar API).

Thanks I'll check it out. What do you do with PDFs that lock text in images, are you using ML/OCR? And as mentioned, tables?

Re: DeepDoctection: Document extraction and analysis using deep learning models

#62

Post by whyleyc » Thu, Apr 27, 2023, 11:22 PM UTC

o_____________o wrote: post #61

whyleyc wrote: post #37

Earlier quoted context omitted.

If you just need to convert the files have you thought about using Zamzar ( https://dev.zamzar.com/ )? We have a file conversion API that supports DOC/DOCX/ODT/PDF/TEX to Markdown conversion in one line of cURL (or you programming language of choice). (Disclaimer: I'm the product lead for the Zamzar API).

Thanks I'll check it out. What do you do with PDFs that lock text in images, are you using ML/OCR? And as mentioned, tables?

Currently OCR support is limited to PDF > TXT conversion but we're hoping to add support for other output formats at some point. Feel free to shoot me an email at chris [at] zamzar [dot] com if you'd like to chat further.

Re: DeepDoctection: Document extraction and analysis using deep learning models

#63

Post by vivegi » Fri, Apr 28, 2023, 12:03 PM UTC

fnordpiglet wrote: post #56

vivegi wrote: post #29

Earlier quoted context omitted.

OCR engines may use a HMM (Hidden Markov Model) for OCR correction.

Yeah, but they don’t do a semantic correction. LLM are extraordinarily more powerful than HMM.

Depends on context though.

An LLM is useless (or not as useful) in OCR for forms where we are trying to extract the name "John Smith" from a name field whereas a HMM trained specifically on name fields may be able to do a better job.

LLMs may perform better as a post processing step for running text (such as book pages).