Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques

github.com

Post reply on HN
Print view View original

1–10 of 29 posts

Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques

#1

Post by hbamoria »

Hey HN fam,

We’ve seen developers spend a lot of time implementing advanced RAG techniques from scratch.

While these techniques are essential for improving performance, their implementation requires a lot of effort and testing!

To help with this process, our team (Athina AI) has released Open-Source Advanced RAG Cookbooks.

This is a collection of ready-to-run Google Colab notebooks featuring the most commonly implemented techniques.

Please show us some love by starring the repo if you find this useful!

Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques
github.com

Re: Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques

#6

Post by Oras »

One of the challenges I have with RAG is excluding table of contents, headers/footers and appendices from PDFs.

Is there a tool/technique to achieve this? I’m aware that I can use LLMs to do so, or read all pages and find identical text (header/footer), but I want to keep the page number as part of the metadata to ensure better citation on retrieval.

Re: Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques

#7

Post by ErikBjare »

imworkingrn wrote: post #5
krawczstef wrote: post #2

+1 for vanilla code without LangChain.

whats wrong with langchain ?

I haven't used it in a year, but my experience was it frequently broke in all sorts of ways. I have since avoided it like the plague.

Re: Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques

#8

Post by imworkingrn »

ErikBjare wrote: post #7
imworkingrn wrote: post #5

Earlier quoted context omitted.

whats wrong with langchain ?

I haven't used it in a year, but my experience was it frequently broke in all sorts of ways. I have since avoided it like the plague.

I hear you. Had the same experience. It's matured a lot since then though. Got back to it a few weeks ago and it feels surprisingly stable.

Re: Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques

#9

Post by prsdm »

Oras wrote: post #6

One of the challenges I have with RAG is excluding table of contents, headers/footers and appendices from PDFs. Is there a tool/technique to achieve this? I’m aware that I can use LLMs to do so, or read all pages and find identical text (header/footer), but I want to keep the page number as part of the metadata to ensure better citation on retrieval.

This might help you: https://github.com/langchain-ai/langchain/blob/master/cookbo...

Re: Show HN: Open-Source Colab Notebooks to Implement Advanced RAG Techniques

#10

Post by prsdm »

imworkingrn wrote: post #8
ErikBjare wrote: post #7

Earlier quoted context omitted.

I haven't used it in a year, but my experience was it frequently broke in all sorts of ways. I have since avoided it like the plague.

I hear you. Had the same experience. It's matured a lot since then though. Got back to it a few weeks ago and it feels surprisingly stable.

it's much more stable now.
Post reply on HN