Hybrid search vs. Token pooling benchmarking
blog.colivara.com
Hybrid search vs. Token pooling benchmarking
1–2 of 2 posts
Re: Hybrid search vs. Token pooling benchmarking
#2Hi HN!
We benchmarked two ways to improve the latency in RAG workflows with a multi-vector setup. Hybrid search using Postgres native capabilities and a relatively new method of token pooling. Token pooling unlocked up to 70% faster latency with <1% performance cost.