mupdf's mutool gives access to most data of all solutions I have checked.
Ask HN: What are you using to parse PDFs for RAG?
31–40 of 102 posts
Re: Ask HN: What are you using to parse PDFs for RAG?
#32I understand your idea, but if you are sure that a software is excellent, then paying for it is a good habit.
25k isn't exactly pocket change!
Re: Ask HN: What are you using to parse PDFs for RAG?
#33PyMuPDF seems to be intended for this use-case and mentions images: https://medium.com/@pymupdf/rag-llm-and-pdf-conversion-to-ma... (Though the article linked above has the feeling, to me, of being at least partly AI-written, which does cause me to pause) > Update: We have now published a new package, PyMuPDF4LLM, to easily convert the pages of a PDF to text in Markdown format. Install via pip with `pip install pymup…
So it works for complicated tables et al.?
You may have to write a custom tracer.
Re: Ask HN: What are you using to parse PDFs for RAG?
#34I've had most success using PDFMinerLoader
(https://api.python.langchain.com/en/latest/document_loaders/...)
It deals pretty well with PDF containing a lot of images.
Re: Ask HN: What are you using to parse PDFs for RAG?
#35Llamaparse by LlamaIndex is probably SOTA at the moment and seems to have no problems with tables. Pricing is good at the moment too.
Re: Ask HN: What are you using to parse PDFs for RAG?
#36have to pay $25K upfront That's a lot of your money. It's not a big dose of OPM (Other People's Money). When building a business, adequate capitalization solve a lot technical problems and it is no different when a business is built. If you aren't building a business, money is different and there's nothing wrong with not building a business. Good luck.
Strange comment and bad advice in general. This is a problem that doesn't need $25k to be solved. You're basically telling them to give up or raise money for no reason at all.
Re: Ask HN: What are you using to parse PDFs for RAG?
#37pyMuPdf and pyMuPdf4llm
Re: Ask HN: What are you using to parse PDFs for RAG?
#38Did you try llamaparse from Llamaindex? It’s a cloud service with a free tier. Recently switched to it from unstructured.io and it works great with the kinds of images and table graphics I feed it.
Re: Ask HN: What are you using to parse PDFs for RAG?
#39Check out this - https://hellorag.ai/
Re: Ask HN: What are you using to parse PDFs for RAG?
#40Have you tried https://github.com/VikParuchuri/marker ?
For my use case, overall Marker seems to work pretty well - but it has issues with tables. Merged cells, misplaced headers, and so forth. I'm currently extracting Polish PDFs that are //not// scanned
When compared to Azure Document Intelligence, Marker is really cheap when self-hosted (assuming you fall under the license requirements), but it does not produce high quality data. YMMV.