Is this using something like https://github.com/creatale/node-fv on the backend, which can accommodate various not perfectly scanned forms to data, after you prepare a schema? Or is it a more simplistic "mark hotspots" which won't work well/at all if if it is not perfectly aligned/sized with the original?
We do position based text extraction. We add however an 'unpaper' function which tries to correct misalignments and increases the quality of the scan.
Show HN: Convert PDF files into structured data
11–20 of 24 posts
Re: Show HN: Convert PDF files into structured data
#12Earlier quoted context omitted.
We do position based text extraction. We add however an 'unpaper' function which tries to correct misalignments and increases the quality of the scan.
What OCR library do you use? What languages it supports?
Re: Show HN: Convert PDF files into structured data
#13Re: Show HN: Convert PDF files into structured data
#14A quick advert for PDF Tables https://pdftables.com/ - we're a bit more API-focussed.
Re: Show HN: Convert PDF files into structured data
#15Re: Show HN: Convert PDF files into structured data
#16Re: Show HN: Convert PDF files into structured data
#17Your online presentation looks great. The 'layout designer' if you will, the 'where are important things' screens look slick.
I do wonder how you assign those settings to incoming PDFs though. Is it the user's responsibility to say 'This PDF? I told you how/from where to extract data before'? Or do you have some classification system that stuffs the PDFs into buckets (say, by vendor) and templates are assigned to those?
How many PDFs that you encounter contain text (vs. scanned/image only documents)? For us, while the former certainly rise in popularity, the latter are still far too common/more prevalent.
Our solution is mostly on-premise so far (online offerings are the current focus of development) and we're quite OCR heavy, using a bunch of non-free engines and vote between the results. We also have dynamic templates, allowing rule sets containing rules like 'The total amount is a number satisfying format X, usually right or below a string containing "Total"' (and our invoice processing solution basically comes with rules like these preconfigured for various countries).
Are your templates using absolute coordinates/regions? You mention your 'unpaper' feature - do you fix/deskew both images and regions for misaligned pages?
(I won't mention any company/product names, because I don't want to advertise or hijack the thread. Nor do I need to connect my HN account ~directly~ with my employer)
Re: Show HN: Convert PDF files into structured data
#18I'm working for a company that does DMS Things™ and processing incoming PDFs (for mailroom applications or invoice processing) is one of our core projects. Given that this is the closest submission to my day job ever, I'm really curious about your project. Your online presentation looks great. The 'layout designer' if you will, the 'where are important things' screens look slick. I do wonder how you assign those sett…
So far, it's the user who would need to decide which document goes to which parser. A routing engine is however on our list and probably be one of the next features to add.
Regarding the stats, I'm not sure yet as we just launched. OCR was however one of the first things early users asked for.
For the 'unpaper' function we are using http://manpages.ubuntu.com/manpages/trusty/man1/unpaper.1.ht...
I would love to discuss things more in detail with you. Could you contact me contact [at] docparser.com please?