How VictoriaLogs Stores Your Logs in a Columnar Layout
victoriametrics.com
How VictoriaLogs Stores Your Logs in a Columnar Layout
1–10 of 12 posts
Re: How VictoriaLogs Stores Your Logs in a Columnar Layout
#2So it’s the same spirit of Clickhouse, how does VictoriaLogs scale?
Re: How VictoriaLogs Stores Your Logs in a Columnar Layout
#3So it’s the same spirit of Clickhouse, how does VictoriaLogs scale?
Vertically on a single machine, the two are quite similar, both fan work out across all CPU cores.
The different is on scaling out.
ClickHouse scales by making you describe the cluster yourself. You decide how many shards to split the data into, how many copies (replicas) each shard keeps, which row goes to which shard. The copies are kept in sync by a consensus system ClickHouse Keeper. This is flexible but also more works on operators.
VictoriaLogs takes the opposite bet. When logs come in, the inserter just spreads them across all storage nodes on its own, so there is no sharding key for you to design. When a query runs, the selector asks every storage node in parallel and merges the results. There is no consensus system at all. If you want high availability, you run 2 independent clusters and send your logs to both, rather than having the database copy data internally. So this is simpler and less learning curve. See more here https://victoriametrics.com/blog/victorialogs-architecture-b...
Re: How VictoriaLogs Stores Your Logs in a Columnar Layout
#4So it’s the same spirit of Clickhouse, how does VictoriaLogs scale?
The answer to your question was deleted, so I'll post it again:
Vertically on a single machine, the two are quite similar, both fan work out across all CPU cores. The different is on scaling out.
ClickHouse scales by making you describe the cluster yourself. You decide how many shards to split the data into, how many copies (replicas) each shard keeps, which row goes to which shard. The copies are kept in sync by a consensus system ClickHouse Keeper. This is flexible but also more works on operators.
VictoriaLogs takes the opposite bet. When logs come in, the inserter just spreads them across all storage nodes on its own, so there is no sharding key for you to design. When a query runs, the selector asks every storage node in parallel and merges the results. There is no consensus system at all. If you want high availability, you run 2 independent clusters and send your logs to both, rather than having the database copy data internally. So this is simpler and less learning curve. See more here https://victoriametrics.com/blog/victorialogs-architecture-b...
Re: How VictoriaLogs Stores Your Logs in a Columnar Layout
#5So it’s the same spirit of Clickhouse, how does VictoriaLogs scale?
The answer to your question was deleted, so I'll post it again: Vertically on a single machine, the two are quite similar, both fan work out across all CPU cores. The different is on scaling out. ClickHouse scales by making you describe the cluster yourself. You decide how many shards to split the data into, how many copies (replicas) each shard keeps, which row goes to which shard. The copies are kept in sync by a c…
So basically if you have queries that are hard on the query planner, that constant fan out has higher CPU cost than the alternatives.
Re: How VictoriaLogs Stores Your Logs in a Columnar Layout
#6Earlier quoted context omitted.
The answer to your question was deleted, so I'll post it again: Vertically on a single machine, the two are quite similar, both fan work out across all CPU cores. The different is on scaling out. ClickHouse scales by making you describe the cluster yourself. You decide how many shards to split the data into, how many copies (replicas) each shard keeps, which row goes to which shard. The copies are kept in sync by a c…
So basically if you have queries that are hard on the query planner, that constant fan out has higher CPU cost than the alternatives.
Taking a look at their LogQL language, I don't see anything that would be particularly hard on the planner. You can't get the fan-out that makes fully relational query planning so difficult with the kind of boolean filters they seem to use. Planning should mostly be a matter of sorting by column cardinality and query optimization so you aren't doing unnecessary operations.
Re: How VictoriaLogs Stores Your Logs in a Columnar Layout
#7So it’s the same spirit of Clickhouse, how does VictoriaLogs scale?
The answer to your question was deleted, so I'll post it again: Vertically on a single machine, the two are quite similar, both fan work out across all CPU cores. The different is on scaling out. ClickHouse scales by making you describe the cluster yourself. You decide how many shards to split the data into, how many copies (replicas) each shard keeps, which row goes to which shard. The copies are kept in sync by a c…
Sounds like the same architecture used by Victoria Metrics storage. I ran it for years on a previous platform and it was so incredibly easy to operate and troubleshoot, and the performance is unreal!
Re: How VictoriaLogs Stores Your Logs in a Columnar Layout
#8Earlier quoted context omitted.
The answer to your question was deleted, so I'll post it again: Vertically on a single machine, the two are quite similar, both fan work out across all CPU cores. The different is on scaling out. ClickHouse scales by making you describe the cluster yourself. You decide how many shards to split the data into, how many copies (replicas) each shard keeps, which row goes to which shard. The copies are kept in sync by a c…
Sounds like the same architecture used by Victoria Metrics storage. I ran it for years on a previous platform and it was so incredibly easy to operate and troubleshoot, and the performance is unreal!
Why did you stop using Victoria metrics and what are you using instead?
Re: How VictoriaLogs Stores Your Logs in a Columnar Layout
#9Shameless plug. But poor Indie hacker's log store based on similar concepts. Write logs to durable s3/r2 in parquet and querying with duckdb: https://github.com/amr8t/blobsearch
No expensive indexing or compute needed.
Re: How VictoriaLogs Stores Your Logs in a Columnar Layout
#10Earlier quoted context omitted.
Sounds like the same architecture used by Victoria Metrics storage. I ran it for years on a previous platform and it was so incredibly easy to operate and troubleshoot, and the performance is unreal!
Why did you stop using Victoria metrics and what are you using instead?
Because I left that team. :D They're still using it and are happy though.
The platform I'm currently working on uses GCP Cloud Metrics, which is all sorts of bad. Funny enough, today I was troubleshooting something on it and after a good 30-40 min of frustration I decided to ask Gemini.
Gemini not only confirmed that Cloud Metrics is incredibly bad, but it listed 5 different ways in which it's a horrible experience and why. I then added one and it went on an 6 paragraphs rant about in which ways that problem was horrible and frustrating.
I've been advocating for migrating to Victoria Metrics, and I think it's going to happen - there's too many competing priorities at the moment though, so it might take a while.