Live data from Hacker News

Show HN: RAG-chunk – A CLI to test RAG chunking strategies

github.com

1–4 of 4 posts

Re: Show HN: RAG-chunk – A CLI to test RAG chunking strategies

#3

Good like these small tools. I'd like to opt for more strategies too like doclings HierarchicalChunker.

Thanks, glad you like the tool! That's exactly the plan. The goal for v0.1 was to build the evaluation harness first (the scoring part). Now that it's in place, adding more strategies like HierarchicalChunker to the 'test bench' is the perfect next step. I've added it to the roadmap!

Re: Show HN: RAG-chunk – A CLI to test RAG chunking strategies

#4
post #3

Good like these small tools. I'd like to opt for more strategies too like doclings HierarchicalChunker.

Thanks, glad you like the tool! That's exactly the plan. The goal for v0.1 was to build the evaluation harness first (the scoring part). Now that it's in place, adding more strategies like HierarchicalChunker to the 'test bench' is the perfect next step. I've added it to the roadmap!

A good thing is to incorporate some old school observability and benchmarking, MLFLOW has been around for some time. You could push some some parameters to that to track your scores, and you could use Meta's AX optimisation framework to finetuning the settings (hyperparameters)