Viewing profile — gingerwizard

Few in this thread have suggested ClickHouse would do well here. We tested 1 trillon rows recently, albeit much simpler data - https://clickhouse.com/blog/clickhouse-1-trillion-row…

Author of the post here, would love to hear ideas for optimization to improve this.

Hey author, here, so yes its not the most recent technique, but when coupled with rescoring like we propose it can be a simple speed up for linear scans. It also a pure SQL solutio…

Some good examples and docs on this data https://clickhouse.com/docs/en/getting-started/example-datas...

Its about a billion rows a day. Nice idea, we could probably add a visual for possible malicious packages.

Thought i'd share some recent work i'd done after being generally frustrated as to the available analytics for Python modules. Most seem to be either limited in time or incur charg…

Just use ClickHouse :) https://sql.clickhouse.com/play?user=play#U0VMRUNUICogRlJPTS...

I'd use clickhouse-local, ideal for this workload without needing to load into a full ClickHouse instance. https://clickhouse.com/blog/extracting-converting-querying-l...