Viewing profile — apurvamehta

It's a demonstration. Kafka is a very popular input for Clickhouse. So are data lakes. The point is neither need Kafka at all.

Thanks! opendata contributor here. We're heavily inspired by Turbopuffer. I'd say we are comparable to them when they launched in terms of perf and scale. But they've obviously inv…

+1 to what @agavra said. It's awesome to see you here @valyala. Your writing and talks about timeseries databases were a great inspriratino for us. I recall one of your earlier tal…

yes. this is current issue. there are two solutions: 1. the reason it's slow as you select more series over longer periods of time is that the series has to be pulled for each time…

Agreed. VictoriaMetrics is indeed a very compelling offering. The disk-less approach is significantly simpler to operate, which I think is the biggest difference. Running opendata'…

Good call out, updated the intro with a summary of the cost benefit. Thanks for the feedback!

From the very same blog post: > Is this Magical Pixie Dust I can sprinkle on my application? > No, not quite. Exactly-once processing is an end-to-end guarantee and the application…

Personally, I would welcome Aphyr trying to break the Kafka EOS guarantees. Like all software, there will be bugs, and the exposure will only make it stronger and more viable. I wr…

Points 1 & 2. There is no direct communication between a producer and consumer. The producer writes to the broker, the consumer reads from the broker. There is a detailed flow diag…

We did our experiments directly on hardware. I don't think that AWS VMs simulate multiple physical sockets. If they don't then this article will not apply to them.

Wow.. that's great to know. We will definitely investigate this approach. Thanks for sharing! :)