Benchmark demonstrates 5-37x improved performance for query on Iceberg tables
1–4 of 4 posts
Re: Benchmark demonstrates 5-37x improved performance for query on Iceberg tables
#2At StarTree, we've taken a novel approach to querying Iceberg tables: applying Apache Pinot-style indexes to improve performance, lower costs, and increase concurrency… without moving data into a separate system.
In our tests on a ~1TB dataset, this reduced query latency significantly:
* 500+ QPS with sub-second latency * Complex aggregations We welcome comments and input from this community!
Re: Benchmark demonstrates 5-37x improved performance for query on Iceberg tables
#3[dead]
Re: Benchmark demonstrates 5-37x improved performance for query on Iceberg tables
#4This is really cool stuff. Amazing the efficiencies Pinot brings to data systems.
[Disclosure: I used to work at StarTree. Still a fan!]