Hi,
I'm looking for a simple way to convert PDFs into markdown with integrated images and tables. Tried Llamaindex, but no integrated images.
Tried Langchain, but some PDFs will have the footer being parsed before the top.
Tried to use Adobe PDF API, but have to pay $25K upfront!
Ask HN: What are you using to parse PDFs for RAG?
1–10 of 102 posts
Re: Ask HN: What are you using to parse PDFs for RAG?
#2have to pay $25K upfront
That's a lot of your money.
It's not a big dose of OPM (Other People's Money).
When building a business, adequate capitalization solve a lot technical problems and it is no different when a business is built. If you aren't building a business, money is different and there's nothing wrong with not building a business. Good luck.
Re: Ask HN: What are you using to parse PDFs for RAG?
#3I would recommend give LLMWhisperer a try with the documents pertaining to your use case.
https://unstract.com/llmwhisperer/
Try demo in playground: https://pg.llmwhisperer.unstract.com/
Quick tutorial: https://unstract.com/blog/extract-table-from-pdf/
Re: Ask HN: What are you using to parse PDFs for RAG?
#4I understand your idea, but if you are sure that a software is excellent, then paying for it is a good habit.
Re: Ask HN: What are you using to parse PDFs for RAG?
#5have to pay $25K upfront That's a lot of your money. It's not a big dose of OPM (Other People's Money). When building a business, adequate capitalization solve a lot technical problems and it is no different when a business is built. If you aren't building a business, money is different and there's nothing wrong with not building a business. Good luck.
Idk man, it's a massive chunk of Other People's Money too. Prices like this is why Microsoft Teams has dominance over Slack.
There's really two use cases:
1. If you don't use the budget, you have less budget. I see this happen a lot in construction too, where each project has a set budget and it goes down or gets stolen in time. They'd rather pay $25k for the lifetime of a 2 year project than pay $500/month. (the other fear is that these startups shut down in a year)
2. Tax exemptions, or some sort of money laundering where there's more value to pay a big name lots of money.
Re: Ask HN: What are you using to parse PDFs for RAG?
#6[dead]
Re: Ask HN: What are you using to parse PDFs for RAG?
#7for web PDFs I'm using https://jina.ai/reader/ — completely free. Does most of the job fine.
Re: Ask HN: What are you using to parse PDFs for RAG?
#8We have an excellent solution for this at Brainchain AI that we call Carnivore.
We're only a few days away from deploying an SDK for this exactly use case among some others.
If you'd like to speak with our team, please contact us! We would love to help you get through your PDF and other file type parsing issues with our solution. Feel free to ping us at data [at] brainchain.ai
Re: Ask HN: What are you using to parse PDFs for RAG?
#9PyMuPDF seems to be intended for this use-case and mentions images:
https://medium.com/@pymupdf/rag-llm-and-pdf-conversion-to-ma...
(Though the article linked above has the feeling, to me, of being at least partly AI-written, which does cause me to pause)
> Update: We have now published a new package, PyMuPDF4LLM, to easily convert the pages of a PDF to text in Markdown format. Install via pip with `pip install pymupdf4llm`. https://pymupdf4llm.readthedocs.io/en/latest/
Re: Ask HN: What are you using to parse PDFs for RAG?
#10What's RAG?