I'm looking for a library that can extract data tables from PDF and can be called from a C++ program (for https://www.easydatatransform.com). If anyone can suggest something, I'm all ears.
OpenDataLoader-PDF: An open source tool for structured PDF parsing
21–30 of 31 posts
Re: OpenDataLoader-PDF: An open source tool for structured PDF parsing
#22Earlier quoted context omitted.
Docling primarily uses AI models to extract PDF content, this project looks like it uses a custom parser written in Java, built atop veraPDF.
Correct me if I am wrong, but Docling can do both. It has also, among other strategies, a non-AI pipeline to determine the layout (based on qpdf I believe). So these projects are not that different.
Re: OpenDataLoader-PDF: An open source tool for structured PDF parsing
#23Earlier quoted context omitted.
The current generation of models all support pretty long context now - the Gemini family has had 1m tokens for over a year, GPT-4.1 is 1m, interestingly GPT-5 is back down to 400,000, Claude 4 is 200,000 but there's a mode of Claude Sonnet 4 that can do 1m as well. The bigger question is how well they perform - there are needle-in-haystack benchmarks that test that, they're mostly scoring quite highly on those now. h…
sorry I should have been more clear, I meant around open source llms. and I guess the question is, how are closed source llm doing it so well. And if OS OpenNote is the best we have...
Re: OpenDataLoader-PDF: An open source tool for structured PDF parsing
#24I got excited until I read that it was Java/Python based. I'm looking for a library that can extract data tables from PDF and can be called from a C++ program (for https://www.easydatatransform.com ). If anyone can suggest something, I'm all ears.
Re: OpenDataLoader-PDF: An open source tool for structured PDF parsing
#25I just tested it on one of my nemeses: PDF bank statements. They're surprisingly tough to work with if you want to get clean, structured transaction data out of them. The JSON extract actually looks pretty good and seems to produce something usable in one shot, which is very good compared to all the other tools I've tried so far, but I still need to check it more in-depth. Sharing here in case someone chimes in with…
Re: OpenDataLoader-PDF: An open source tool for structured PDF parsing
#26I've been thinking lately that maybe we need a new AI-friendly file format rather than continuing to hack on top of PDF's complicated spec. PDF was designed to have consistent and portable page display rendering, it was not a goal for it to be easily parseable afaik, which is why we have to go through these crazy hoops. If you've ever looked at how text is stored internally in PDF this becomes immediately obvious. I'…
Re: OpenDataLoader-PDF: An open source tool for structured PDF parsing
#27I've been thinking lately that maybe we need a new AI-friendly file format rather than continuing to hack on top of PDF's complicated spec. PDF was designed to have consistent and portable page display rendering, it was not a goal for it to be easily parseable afaik, which is why we have to go through these crazy hoops. If you've ever looked at how text is stored internally in PDF this becomes immediately obvious. I'…
Doesn't Latex do this?
Re: OpenDataLoader-PDF: An open source tool for structured PDF parsing
#28I got excited until I read that it was Java/Python based. I'm looking for a library that can extract data tables from PDF and can be called from a C++ program (for https://www.easydatatransform.com ). If anyone can suggest something, I'm all ears.
What makes Java/Python not able to be called from C++, or did you mean you have other requirements that make the project unsuitable?